Skip to content

Evaluate prompt version

POST
/api/v1/tuning/prompts/{version_id}/evaluate

Run evaluation suite on a prompt version.

Authorizations

Parameters

Path Parameters

version_id
required
string

Responses

200

Successful Response

Aggregated result of evaluating a prompt version.

object
avg_overall
required
number
avg_scores
required
object
key
additional properties
number
case_results
required
Array<object>

Result of evaluating a prompt version against one case.

object
case_id
required
string format: uuid
overall_score
required
number
scores
required
object
key
additional properties
number
version_id
required
string format: uuid
version_id
required
string format: uuid

422

Validation Error

object
detail
Array<object>
object
ctx
object
input
loc
required
Array
msg
required
string
type
required
string