APIAnalytics

LLM token economics

Cache-hit rate, blended $/MTok, and token-type cost shares for a time range. The blended rate uses provider-reported cost. Providers don't report cost per token type, so by_type is priced from configured list prices instead and carries priced_tokens — the share of its tokens that pricing covered. For the users driving that cost, page /analytics/llm-top-users-by-cost.

GET
/analytics/llm-token-economics

Cache-hit rate, blended $/MTok, and token-type cost shares for a time range. The blended rate uses provider-reported cost. Providers don't report cost per token type, so by_type is priced from configured list prices instead and carries priced_tokens — the share of its tokens that pricing covered. For the users driving that cost, page /analytics/llm-top-users-by-cost.

Authorization

ApiKeyAuth
headerAuthorizationBearer <token>

Bearer token authentication. Send an API key (a saai_api_-prefixed token) as Authorization: Bearer <token>.

Required permission

view_llm_analytics

Query Parameters

scope?string

own returns only the caller's own records, even when they may see the whole organization. all, the default, returns everything the caller may see. It never widens what the caller may see.

Value in"all""own"
start_time*string

Start of the time range to report on, inclusive.

Formatdate-time
end_time*string

End of the time range to report on, exclusive.

Formatdate-time
provider?array<>

Filter to specific LLM telemetry providers.

model?array<string>

Filter to specific model names.

user_id?array<>

Filter to specific users by id.

user_group?array<string>

Filter to users in specific groups.

auth_mode?array<>

Response Body

The request has succeeded.

application/json
  1. response

Cache economics and token-type cost shares for a time range.

by_type*array<>
cache_hit_rate*number

cache_read / (input + cache_read + cache_creation), 0–1.

Formatdouble
cost_per_mtok*number

Blended reported USD per million tokens.

Formatdouble
Example Request
curl -X GET 'https://your-org.aisecurity.services.us.connect.secureauth.com/api/v1/analytics/llm-token-economics?start_time=2019-08-24T14%3A15%3A22Z&end_time=2019-08-24T14%3A15%3A22Z'
Example Response
{  "by_type": [    {      "token_type": "string",      "tokens": 0,      "priced_tokens": 0,      "weighted_cost": 0.1    }  ],  "cache_hit_rate": 0.1,  "cost_per_mtok": 0.1}