Generated at:
Create a generative AI evaluation
/api/generative-ai-evaluationsCreates an evaluation that has an LLM judge score a sample of the generative AI spans its
filters match. metadata.name must be unique within the dataset and cannot change later.
A dash0.com/origin label must be unique within the organization and must not start with a
prefix Dash0 reserves; a duplicate or reserved origin returns 400. A dash0.com/id label
returns 400, because the server assigns the ID. When an API token without a user sends no
origin, the server sets one.
Query parameters 1
datasetDataset to create the evaluation in. Takes precedence over the dash0.com/dataset label; defaults to the default dataset.
When omitted, the request uses the Dash0-Dataset header. See Selecting a dataset.
The slug of a dataset, such as default. Where a request may omit it, "Selecting a dataset" in the API introduction describes how the dataset is chosen.
"^[a-zA-Z0-9_-]{3,26}$"Sample requestcurl --request POST 'https://api.eu-west-1.aws.dash0.com/api/generative-ai-evaluations' \
--header "Authorization: Bearer ${DASH0_AUTH_TOKEN}" \
--header 'Content-Type: application/json' \
--data-raw '{
"kind": "Dash0GenerativeAiEvaluation",
"metadata": {
"name": "Example"
},
"spec": {
"enabled": true,
"display": {
"name": "Example"
},
"match": {
"filters": [
{
"key": "service.name",
"operator": "is",
"value": "shop"
}
]
},
"sample": {
"rate": 1
},
"judge": {
"model": "light",
"systemPrompt": "example",
"userPrompt": "example",
"output": {
"kind": "numeric",
"spec": {}
}
}
}
}'Request body required
"Dash0GenerativeAiEvaluation"Responses
The generative AI evaluation was created.
"Dash0GenerativeAiEvaluation"