AutoMerge is generally available

Generated at:

Manage Generative AI Evaluations

Create a generative AI evaluation

post/api/generative-ai-evaluations

Creates an evaluation that has an LLM judge score a sample of the generative AI spans its filters match. metadata.name must be unique within the dataset and cannot change later.

A dash0.com/origin label must be unique within the organization and must not start with a prefix Dash0 reserves; a duplicate or reserved origin returns 400. A dash0.com/id label returns 400, because the server assigns the ID. When an API token without a user sends no origin, the server sets one.

Query parameters 1

dataset

Dataset to create the evaluation in. Takes precedence over the dash0.com/dataset label; defaults to the default dataset.

When omitted, the request uses the Dash0-Dataset header. See Selecting a dataset.

References Dataset

The slug of a dataset, such as default. Where a request may omit it, "Selecting a dataset" in the API introduction describes how the dataset is chosen.

stringpattern "^[a-zA-Z0-9_-]{3,26}$"
bash
Sample requestcurl --request POST 'https://api.eu-west-1.aws.dash0.com/api/generative-ai-evaluations' \
  --header "Authorization: Bearer ${DASH0_AUTH_TOKEN}" \
  --header 'Content-Type: application/json' \
  --data-raw '{
  "kind": "Dash0GenerativeAiEvaluation",
  "metadata": {
    "name": "Example"
  },
  "spec": {
    "enabled": true,
    "display": {
      "name": "Example"
    },
    "match": {
      "filters": [
        {
          "key": "service.name",
          "operator": "is",
          "value": "shop"
        }
      ]
    },
    "sample": {
      "rate": 1
    },
    "judge": {
      "model": "light",
      "systemPrompt": "example",
      "userPrompt": "example",
      "output": {
        "kind": "numeric",
        "spec": {}
      }
    }
  }
}'

Request body required

stringrequired
"Dash0GenerativeAiEvaluation"

Responses

The generative AI evaluation was created.

stringrequired
"Dash0GenerativeAiEvaluation"