Ask Agent0 to draft, explain, and fix your evals
Agent0 now works with evals. Describe what to check and it drafts the eval, explains why results changed, and proposes fixes for you to review and apply.
A good eval rarely works on the first try. You write the rubric, wait for verdicts, and then find that half the spans lack the attribute your prompt reads, or that the judge marks a fine answer as a hallucination. Until now, every round meant going back to the eval form yourself.
Now you can hand that loop to Agent0.
On the Evals page, click the arrow next to Create new and select Ask Agent0, or ask in any Agent0 chat. Describe what you want to check, such as "flag answers where the support bot promises a refund", and Agent0 drafts the whole eval: span filters, output type, prompts, judge model, and sample rate.
It checks your spans first. Before it proposes an eval, Agent0 looks at recent spans that match the filters. It tells you when no spans match, or when they lack an attribute the prompt reads, so you don't create an eval that skips every span.
It explains results. Ask how often an eval failed this week, which spans scored lowest, whether the failures share an agent, model, or deployment, or what your evals cost per agent. Agent0 links every span it cites to its trace.
It fixes evals. Ask why an eval shows no results, have Agent0 review a rubric for ambiguity, or tell it that a verdict is wrong. It proposes the fix. It also warns you when a change makes new results incomparable with earlier ones, or when it raises spending.
You apply every change. Each new or changed eval arrives as a card. Preview it in the eval editor, then click Create eval or Update eval. Agent0 doesn't delete evals, and it doesn't touch evals you manage as code.
Read the docs: Use Agent0 with Evals