Component schema

GenerativeAiEvaluationJudge

object1 direct reference

Definition

The model class used to judge an evaluation. Availability depends on the region and evaluation workload. Dash0 manages the serving model privately.

light: Fast, low-cost evaluations.
standard: Balanced quality and cost.

"light""standard"

stringrequired

The prompt sent to the judge for each evaluated span. {{ key }} is replaced with the value of the span or resource attribute key. A span is skipped when a referenced attribute is missing or empty, unless allowPartialPrompt is set.

boolean

Judge spans that carry only some of the attributes the user prompt references. A missing or empty attribute is replaced with <missing attribute key>. A span is still skipped when no referenced attribute resolves to non-redacted content. Defaults to false.

GenerativeAiEvaluationJudgeOutputanyOf · 3 variantsrequired

Used by 1

These schemas and endpoints reference this type directly.

SchemaGenerativeAiEvaluationSpec

json

OpenAPI source{
  "properties": {
    "model": {
      "$ref": "#/components/schemas/GenerativeAiEvaluationModel"
    },
    "systemPrompt": {
      "type": "string"
    },
    "userPrompt": {
      "description": "The prompt sent to the judge for each evaluated span. `{{ key }}` is replaced with the\nvalue of the span or resource attribute `key`. A span is skipped when a referenced\nattribute is missing or empty, unless `allowPartialPrompt` is set.\n",
      "type": "string"
    },
    "allowPartialPrompt": {
      "description": "Judge spans that carry only some of the attributes the user prompt references. A\nmissing or empty attribute is replaced with `<missing attribute key>`. A span is still\nskipped when no referenced attribute resolves to non-redacted content. Defaults to false.\n",
      "type": "boolean"
    },
    "output": {
      "$ref": "#/components/schemas/GenerativeAiEvaluationJudgeOutput"
    }
  },
  "required": [
    "model",
    "systemPrompt",
    "userPrompt",
    "output"
  ]
}