Overview

Real-time LLM usage and cost insights
Total Requests
last 7 days
Total Cost
USD
Total Tokens
prompt + completion
Avg Latency
end-to-end response time
Error Rate
of all requests
Cache Hit Rate
requests from cache
System Health
Database
Checking…
Routing Strategy
active
Circuit Breakers
All closed
closed
Active Keys
ok
Requests Over Time
Request volume across all providers
Cost by Provider
Cost Over Time
USD spend per day
Tokens by Model
Hourly Request Volume
Requests per hour (last 7 days)
Token Usage Over Time
Latency Percentiles by Model
P50, P90, P99 in milliseconds
Period Total
Cost / Request
Cost / 1K Tokens
Projected 30d
Daily Cost Breakdown
Model Cost Breakdown
ProviderModelRequests TokensCost (USD)Cost / 1K tokAvg Latency
User Cost & Usage
UserEmailRequests TokensCost (USD)BudgetUtilizationAvg Latency
Budget Status (Current Month)
UserBudget (USD)Spent (USD) Remaining (USD)Utilization
Model Performance & Cost
ProviderModelRequests Prompt Tok.Compl. Tok. Cost (USD)P50P90P99
Pricing Reference
ProviderModel Input ($/1M tok)Output ($/1M tok)
Per-User Quota Status Real-time counters — reset at period boundary
User Period Resets Tokens Used Token Quota Token Util% Requests Used Request Quota Req Util% Status
Quota Configuration
Set per-user quotas via the Admin API. Setting either limit to 0 disables that dimension. quota_period accepts "daily", "weekly", or "monthly".
curl -X PATCH http://localhost:8000/admin/users/<user_id> \
  -H "x-admin-key: $ADMIN_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "token_quota": 1000000,
    "request_quota": 500,
    "quota_period": "monthly",
    "quota_enabled": true
  }'
TimeProviderModelTokens CostLatencyStatusCacheStream
Virtual API Keys
NameKey PrefixProvider RoutingRPMTPMDaily Limit Last UsedStatus
Provider Keys
Provider Name Organization Weight Priority Health Last Used Status Actions
Add Provider Key
Pool Policy

Only applies once an organization/provider has 2+ active keys — controls how requests are spread across the pool and what happens if every key is cooling down after failures.

Community
Customer
License ID
Issued
Expires
Source
Usage vs License Limits
Licensed Features
Manage License
License activation and removal are managed from the Admin Console.
Tier Comparison
Feature / Limit Community Professional Enterprise
Distributed Traces
Trace ID Spans Model Provider Cost Duration Status Started
Total Requests
Cache Hits
Hit Rate
Cost Savings
Hit Rate by Model
Cache Breakdown by Model
Model Provider Requests Cache Hits Hit Rate Savings (USD)
Cache Breakdown by User
User Requests Cache Hits Hit Rate Savings (USD)
MCP Gateway Traffic
Read-only usage across upstream tool calls and the inbound gateway. To register or configure MCP servers, use the Admin Console.
Calls
Cost
Input Tokens
Output Tokens
Breakdown by Tool
Tool Calls Cost Success Error Rate P50 P95