Skip to content
UltimateTeam.ai Docs

Create A/B test

POST
/api/v1/tuning/ab-tests

Create a new agent response A/B test.

Authorizations

Request Body required

Request body for creating an agent response A/B test.

object
agent_role
required
string
>= 1 characters <= 100 characters
behavior_dimension
required
string
>= 1 characters <= 100 characters
min_tenants
integer
default: 50 >= 1
name
required
string
>= 1 characters <= 255 characters
significance_threshold
number
default: 0.05 > 0 < 1
variants
required
Array<object>

Request body for creating a response test variant.

object
config
object
key
additional properties
any
name
required
string
>= 1 characters <= 100 characters

Responses

201

Successful Response

Response body for an agent response A/B test.

object
agent_role
required
string
behavior_dimension
required
string
concluded_at
Any of:
string format: date-time
created_at
required
string format: date-time
id
required
string format: uuid
min_tenants
required
integer
name
required
string
significance_threshold
required
number
status
required
string
variants
required
Array<object>

Response body for a single response test variant.

object
acceptance_count
required
integer
acceptance_rate
number
config
required
object
key
additional properties
any
id
required
string format: uuid
name
required
string
override_count
required
integer
satisfaction_sum
required
number
tenant_count
required
integer
winner_variant
Any of:
string

422

Validation Error

object
detail
Array<object>
object
ctx
object
input
loc
required
Array
msg
required
string
type
required
string