Documentation Index
Fetch the complete documentation index at: https://docs.llmgrid.ai/llms.txt
Use this file to discover all available pages before exploring further.
Overview
The LLMGrid Console organizes features in the left navigation to help you manage access, models, routing behavior, costs, and integrations within a tenant.Tenant
Tenant selector
Use the tenant selector at the top of the sidebar to view and manage resources for the currently selected tenant. All settings, usage, and permissions apply within the active tenant.Overview
Usage
View high-level platform consumption and activity. Use this section to understand adoption and overall usage patterns.Logs
Review request and execution logs for troubleshooting, auditing, and operational visibility. Use logs to investigate failures, latency, and unexpected responses.Access & Identity
Virtual Keys
Create and manage API keys for programmatic access to LLMGrid. Common tasks- Create keys for applications, services, and automation
- Rotate keys periodically
- Track usage by key
Teams
Organize users into teams for simpler access management and governance. Common tasks- Group users by project or function
- Assign permissions consistently across a team
Organizations
Manage organizations for segmented access and reporting. Common use cases- Multi-department or multi-entity structures
- Partitioned reporting and access boundaries
Internal Users
Manage user accounts within the tenant. Common tasks- Add, remove, and update users
- Assign users to teams and organizations
- Manage access roles (based on your tenant configuration)
Billing
View billing details and subscription information for the tenant.AI & Models
Models
View and manage available AI models for the tenant. Common tasks- Verify which models are enabled
- Configure model availability (based on your tenant setup)
Playground
Test models interactively to validate prompts and responses before production use. Use Playground to- Experiment with prompts
- Compare outputs
- Validate expected behavior quickly
AI Hub
Access a central place for AI-related capabilities and assets available in the console.MCP Servers
Manage MCP servers that connect models to tools and external systems for tool-augmented and context-aware workflows.Agents
Create and manage agents that execute goal-driven workflows using models and connected tools. Typical uses- Task automation
- Tool-assisted reasoning and execution
- Controlled, repeatable agent behavior
Prompts
Maintain a library of reusable prompts. Benefits- Consistency across teams
- Reuse and standardization
- Easier iteration on production prompt patterns
API Playground
Test API requests interactively. Use API Playground to- Validate authentication and request format
- Inspect responses
- Iterate quickly during integration
Routing & Behavior
Router Settings
Configure request routing behavior. Typical configurations- Model selection rules
- Fallback strategies
- Routing preferences for reliability
Guardrails
Define safety and compliance rules for AI interactions. Typical guardrails- Output constraints
- Policy enforcement
- Validation and filtering rules
Caching
Control response caching behavior to improve latency and reduce repeat costs.Costs & Governance
Budgets
Set budgets to manage and limit spend. Common uses- Avoid unexpected cost spikes
- Allocate budgets by team or initiative
Cost Tracking
Analyze cost and usage trends and attribute spend across the tenant based on available dimensions (e.g., model, key, team).Tag Management
Create and manage tags to improve reporting and governance. Use tags to- Attribute usage to projects
- Filter analytics views
- Support cost allocation