Routing Metrics: Timeseries Examples

Timeseries queries

Time-bucketed routing metrics over a window. Every timeseries query must include interval (or the deprecated intervalInSeconds). Each example below posts JSON to:

POST https://{your_control_plane_url}/api/svc/v1/llm-gateway/metrics/query

with Authorization: Bearer <your_api_key> and Content-Type: application/json. To keep the snippets short, only the JSON body is shown; the wrapper is identical to the Overview Quick Start.

Hourly routing volume by config type

Hourly applications per configType:

json={
    "startTs": "2026-04-21T00:00:00.000Z",
    "endTs": "2026-04-22T00:00:00.000Z",
    "datasource": "configMetrics",
    "type": "timeseries",
    "interval": "1 hour",
    "groupBy": ["configType"]
}

Hourly average attempts per rule

Track loadbalance rule pressure over time:

json={
    "startTs": "2026-04-21T00:00:00.000Z",
    "endTs": "2026-04-22T00:00:00.000Z",
    "datasource": "configMetrics",
    "type": "timeseries",
    "interval": "1 hour",
    "aggregations": [
        {"type": "avg", "column": "loadbalanceTargetAttemptCount"}
    ],
    "groupBy": ["loadbalanceRuleId"]
}

Hourly routing volume per requested-to-target pair

Useful to confirm a routing change took effect:

json={
    "startTs": "2026-04-21T00:00:00.000Z",
    "endTs": "2026-04-22T00:00:00.000Z",
    "datasource": "configMetrics",
    "type": "timeseries",
    "interval": "1 hour",
    "aggregations": [
        {"type": "sum", "column": "loadbalanceTargetAttemptCount"}
    ],
    "groupBy": ["requestedModel", "targetModel"]
}

Hourly outcome breakdown

Volume per status over time:

json={
    "startTs": "2026-04-21T00:00:00.000Z",
    "endTs": "2026-04-22T00:00:00.000Z",
    "datasource": "configMetrics",
    "type": "timeseries",
    "interval": "1 hour",
    "groupBy": ["status"]
}

5-minute traffic during an incident

Fine-grained breakdown to investigate a routing change:

json={
    "startTs": "2026-04-21T14:00:00.000Z",
    "endTs": "2026-04-21T16:00:00.000Z",
    "datasource": "configMetrics",
    "type": "timeseries",
    "interval": "5 minute",
    "aggregations": [
        {"type": "sum", "column": "loadbalanceTargetAttemptCount"}
    ],
    "groupBy": ["targetModel"],
    "filters": [
        {"fieldName": "requestedModel", "operator": "IN", "value": ["gpt-4"]}
    ]
}

Daily routings over a week

Daily routing volume across a 7-day window:

json={
    "startTs": "2026-04-14T00:00:00.000Z",
    "endTs": "2026-04-21T00:00:00.000Z",
    "datasource": "configMetrics",
    "type": "timeseries",
    "interval": "1 day",
    "groupBy": ["configType"]
}

Hourly activity for a specific ratelimit rule

Watch a single rule’s volume over time:

json={
    "startTs": "2026-04-21T00:00:00.000Z",
    "endTs": "2026-04-22T00:00:00.000Z",
    "datasource": "configMetrics",
    "type": "timeseries",
    "interval": "1 hour",
    "groupBy": ["status"],
    "filters": [
        {"fieldName": "ratelimitRuleId", "operator": "IN", "value": ["<rule-id>"]}
    ]
}

Get Started

LLM Gateway

MCP Registry and Gateway

Skills Registry

Prompt Registry

Guardrails and Security

Observability

Deployment

Admin Guide

Chat

Messages

Embeddings

Rerank

Responses

Image

Audio

Batch

Files

Fine-tuning

Moderations

Models

Routing Metrics: Timeseries Examples

Timeseries queries

​Timeseries queries

Timeseries queries