Skip to content
UltimateTeam.ai Docs

Get Model Comparison

GET
/admin/eval/models
curl --request GET \
  --url 'https://api.ultimateteam.ai/admin/eval/models?days=30' \
  --header 'X-API-Key: <X-API-Key>'

Return pass-rate / latency / score aggregates per model × role.

Args: days: Trailing window (1..90). session: Async DB session. _admin: Operator auth gate.

Returns: List of :class:ModelRow rows, one per (model, role) pair that saw any runs in the window.

Authorizations

Section titled “Authorizations”

Parameters

Section titled “ Parameters ”

Query Parameters

Section titled “Query Parameters”
days
Days

Window size in days.

integer
default: 30 >= 1 <= 90

Window size in days.

Responses

Section titled “ Responses ”

200

Section titled “200”

Successful Response

Media typeapplication/json
Response Get Model Comparison Admin Eval Models Get
Array<object>
ModelRow

Aggregated performance for one model_used × role combination.

object
avg_latency_ms
required
Avg Latency Ms
number
avg_score
required
Avg Score
number
model_used
required
Model Used
string
n
required
N
integer
pass_rate
required
Pass Rate
number
role
required
Role
string
Examplegenerated
[
  {
    "avg_latency_ms": 1,
    "avg_score": 1,
    "model_used": "example",
    "n": 1,
    "pass_rate": 1,
    "role": "example"
  }
]

422

Section titled “422”

Validation Error

Media typeapplication/json
HTTPValidationError
object
detail
Detail
Array<object>
ValidationError
object
ctx
Context
object
input
Input
loc
required
Location
Array
msg
required
Message
string
type
required
Error Type
string
Examplegenerated
{
  "detail": [
    {
      "ctx": {},
      "input": "example",
      "loc": [
        "example"
      ],
      "msg": "example",
      "type": "example"
    }
  ]
}