APIAnalytics

LLM token economics

Cache-hit rate, blended $/MTok, and token-type cost shares for a time range. The blended rate uses provider-reported cost. Providers don't report cost per token type, so by_type is priced from configured list prices instead and carries priced_tokens — the share of its tokens that pricing covered. For the users driving that cost, page /analytics/llm-top-users-by-cost.

GET/analytics/llm-token-economics

Cache-hit rate, blended $/MTok, and token-type cost shares for a time range. The blended rate uses provider-reported cost. Providers don't report cost per token type, so by_type is priced from configured list prices instead and carries priced_tokens — the share of its tokens that pricing covered. For the users driving that cost, page /analytics/llm-top-users-by-cost.

Query Parameters

start_time*string

Start of the time range to report on, inclusive.

Formatdate-time
end_time*string

End of the time range to report on, exclusive.

Formatdate-time
provider?array<>

Filter to specific LLM telemetry providers.

model?array<string>

Filter to specific model names.

user_id?array<>

Filter to specific users by id.

user_group?array<string>

Filter to users in specific groups.

auth_mode?array<>

Response Body

application/json

application/json

curl -X GET "https://example.com/analytics/llm-token-economics?start_time=2019-08-24T14%3A15%3A22Z&end_time=2019-08-24T14%3A15%3A22Z"
{  "by_type": [    {      "token_type": "string",      "tokens": 0,      "priced_tokens": 0,      "weighted_cost": 0.1    }  ],  "cache_hit_rate": 0.1,  "cost_per_mtok": 0.1}