​

Settings

​

1. API Keys

• Provider Keys: Add and manage API keys for supported LLM providers (e.g., OpenAI, Anthropic, Azure OpenAI).
• Encryption: All keys are stored securely using AES-256 encryption and never exposed in plain text.
• Rotation: Rotate keys periodically for enhanced security.

​

2. Default Model

• Set a default model for your tenant (e.g., gpt-4, claude-3).
• Override defaults at the route level or request level.

​

3. Logging & Observability

• Enable/Disable Logs: Toggle request/response logging.
• Retention Policy: Configure log retention (e.g., 30 days, 90 days).
• Export Logs: Download logs in CSV or JSON format for auditing.

​

4. Rate Limits

• Define per-tenant and per-user rate limits.
• Configure burst limits and throttling to prevent abuse.

​

5. Security

• OAuth2.0 Integration: Enable secure authentication for API calls.
• IP Whitelisting: Restrict access to specific IP ranges.
• Audit Trails: Track configuration changes with timestamps and user IDs.

​

6. Advanced Settings

• Timeouts: Set global request timeout (e.g., 30s).
• Retries: Configure retry logic for failed requests.
• Fallback Models: Define backup models if primary fails.