Skip to content
UltimateTeam.ai Docs

Confidence calibration data per agent

GET
/api/v1/decisions/calibration
curl --request GET \
  --url 'https://api.ultimateteam.ai/api/v1/decisions/calibration?period=30' \
  --header 'X-API-Key: <X-API-Key>'

Returns confidence calibration metrics for the specified agent over the requested time window. Calibration compares stated confidence levels against actual outcome quality.

Authorizations

Section titled “Authorizations”

Parameters

Section titled “ Parameters ”

Query Parameters

Section titled “Query Parameters”
agent
Any of:
string

Agent role to analyze (e.g. ‘cro’). Omit for the first available agent or a default summary.

period
Period

Look-back window in days

integer
default: 30 >= 1 <= 365

Look-back window in days

Responses

Section titled “ Responses ”

200

Section titled “200”

Successful Response

Media typeapplication/json
DecisionsCalibrationResponse

Response for GET /api/v1/decisions/calibration.

object
agent
required
Agent
string
calibration_score
required
Calibration Score
number
data_points
required
Data Points
Array<object>
CalibrationDataPoint

A single calibration data point mapping confidence to actual success rate.

object
actual_success_rate
required
Actual Success Rate
number
confidence
required
Confidence
number
count
required
Count
integer
Examplegenerated
{
  "agent": "example",
  "calibration_score": 1,
  "data_points": [
    {
      "actual_success_rate": 1,
      "confidence": 1,
      "count": 1
    }
  ]
}

422

Section titled “422”

Validation Error

Media typeapplication/json
HTTPValidationError
object
detail
Detail
Array<object>
ValidationError
object
ctx
Context
object
input
Input
loc
required
Location
Array
msg
required
Message
string
type
required
Error Type
string
Examplegenerated
{
  "detail": [
    {
      "ctx": {},
      "input": "example",
      "loc": [
        "example"
      ],
      "msg": "example",
      "type": "example"
    }
  ]
}