Evals
Evals API
Manage evaluation definitions, trigger runs, and query results.
POST
/api/evalsCreate a new eval definition.
jsonRequest Body
{
"name": "json-check",
"type": "static",
"evaluator": "is_json",
"config": { "field": "completion" },
"enabled": true
}GET
/api/evalsList definitions. Filter with ?type= and ?enabled=.
GET
/api/evals/:idGet a specific eval definition.
PUT
/api/evals/:idUpdate an eval definition.
DELETE
/api/evals/:idDelete an eval definition.
POST
/api/evals/:id/runTrigger a manual evaluation run against recent traces.
GET
/api/evals/:id/resultsList evaluation results for a definition.
jsonResponse
[
{
"id": 1,
"eval_id": 5,
"log_id": 142,
"score": 1.0,
"passed": true,
"details": "Field 'completion' is valid JSON",
"created_at": "2025-03-15T10:30:00Z"
}
]GET
/api/evals/runsList all evaluation runs.
GET
/api/evals/runs/:runIdGet details of a specific run.