AutoMerge is generally available

Generated at:

Manage Generative AI Evaluations

Update or insert a generative AI evaluation

put/api/generative-ai-evaluations/{originOrId}

Replaces the evaluation's definition. When no evaluation matches, the path parameter becomes the origin of a new evaluation, which is how infrastructure-as-code tools apply a definition; a path parameter shaped like an evaluation ID returns 404 instead. A PUT to a deleted evaluation restores it.

metadata.name and the judge's output kind cannot change; send a new evaluation instead. Send the dash0.com/version label you read to reject the write when someone else changed the evaluation since; omit it to overwrite unconditionally. A PUT that changes nothing returns the evaluation unchanged without creating a new version.

Path parameters 1

originOrIdrequired

Generative AI evaluation origin or ID.

string

Query parameters 1

dataset

When omitted, the request uses the Dash0-Dataset header. See Selecting a dataset.

References Dataset

The slug of a dataset, such as default. Where a request may omit it, "Selecting a dataset" in the API introduction describes how the dataset is chosen.

stringpattern "^[a-zA-Z0-9_-]{3,26}$"
bash
Sample requestcurl --request PUT 'https://api.eu-west-1.aws.dash0.com/api/generative-ai-evaluations/123e4567-e89b-42d3-a456-426614174000' \
  --header "Authorization: Bearer ${DASH0_AUTH_TOKEN}" \
  --header 'Content-Type: application/json' \
  --data-raw '{
  "kind": "Dash0GenerativeAiEvaluation",
  "metadata": {
    "name": "Example"
  },
  "spec": {
    "enabled": true,
    "display": {
      "name": "Example"
    },
    "match": {
      "filters": [
        {
          "key": "service.name",
          "operator": "is",
          "value": "shop"
        }
      ]
    },
    "sample": {
      "rate": 1
    },
    "judge": {
      "model": "light",
      "systemPrompt": "example",
      "userPrompt": "example",
      "output": {
        "kind": "numeric",
        "spec": {}
      }
    }
  }
}'

Request body required

stringrequired
"Dash0GenerativeAiEvaluation"

Responses

The generative AI evaluation was updated or inserted.

stringrequired
"Dash0GenerativeAiEvaluation"