Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.llmgrid.ai/llms.txt

Use this file to discover all available pages before exploring further.

Overview

The Budgets page allows administrators to define usage budgets that can be assigned to customers or end users. Budgets act as governance controls by limiting request rates, token usage, and overall consumption, helping enforce fair usage and prevent overconsumption. Budgets are reusable objects that can be applied across multiple users.

Budgets List

The main Budgets page displays all configured budgets for the tenant.

Primary Actions

  • Create Budget
    Opens the budget creation dialog.

Budgets Table

Each row in the table represents a budget definition. Columns include:
  • Budget ID
    Unique identifier of the budget.
  • Max Budget
    Maximum allowed usage defined for the budget (if configured).
  • TPM
    Tokens‑per‑minute limit applied by the budget.
  • RPM
    Requests‑per‑minute limit applied by the budget.
If no budgets exist, the table displays an empty state message.

Create Budget

Select Create Budget to define a new budget.

Required Fields

Budget ID

A unique, human‑friendly identifier used to reference the budget. This ID is used when assigning a budget to a user.

Rate Limits

Max Tokens per Minute

Defines the maximum number of tokens allowed per minute. If not set, the default model limits apply.

Max Requests per Minute

Defines the maximum number of requests allowed per minute. If not set, the default model limits apply.

Optional Settings

Optional settings provide additional governance controls.

Max Budget

Defines a maximum overall usage threshold for the budget.

Reset Budget

Controls whether and when the budget usage resets. Examples:
  • No reset
  • Periodic reset (based on tenant configuration)

Create Budget Action

Select Create Budget to save the budget. Once created, the budget becomes available for assignment to customers or users.

Assign Budget to Customer

Budgets are applied by assigning them to users.

Assign via API

Use the Assign Budget to Customer section to associate a budget with a user.

Example (cURL)

curl -X POST --location 'hhtps://api.llmgrid.ai/end_user/new' \
  -H 'Authorization: Bearer <your-master-key>' \
  -H 'Content-Type: application/json' \
  -d '{
    "user_id": "my-customer-id",
    "budget_id": "<BUDGET_ID>"
  }'