Skip to content

Explore CallMissed

Agent testing & qualityTest the change. Read the evidence.

A prompt change deserves more than a quick listen. Build repeatable evaluation cases, inspect the results and compare variants against a metric you choose in advance.

An engineering testing bench with reference books and review sheets

Simulated example

  1. Write the case

    Example case / A caller asks to speak to a person.

  2. Run the call

    A simulated caller follows its persona while the agent answers.

  3. Read the assertions

    Each assertion is checked against the transcript and marked pass or fail.

In the console

A suite run, a failure, a winner

Replay every scripted caller in a suite, open the case that failed to see which assertion broke and why, then record the winning variant of a live experiment.

Demo: running an eval suite, inspecting the failed case's transcript, and an experiment's winning arm

Inside Agent testing & quality

Evaluate scripted cases, score conversations and compare agent variants.

  • Eval suites
  • Caller personas
  • Assertions
  • Transcripts
  • Scorecards
  • A/B experiments
  • Squads

Repeatable scenarios

Create an evaluation suite for an agent with caller personas, opening lines and success criteria. Include normal requests and difficult boundaries.

Inspect each result

Read the transcript and per-assertion result for each case instead of relying only on a summary pass count.

Score what matters

Use scorecards to define your quality criteria and inspect the breakdown for a conversation or evaluation run.

Compare agent variants

Configure experiment arms and traffic splits, assign callers through the experiment API and read results against a selected metric. Organize specialized agents into squads where supported.

A clay miniature testing bench with tiny dials and review sheets

Run a case yourself

Step through one simulated evaluation. Pick a case, advance the conversation, then reveal what each assertion found.

Evaluation suite

Persona
Impatient caller
Opening line
“Can I just talk to a person?”

Simulated example — eval runs use models and consume credits in the real product.

  1. The transcript appears here when you run the case.
Simulated example. Scores are evidence for review, not proof of real-world performance.

Three steps to a working setup

  1. 1

    Choose an agent and write representative test cases with explicit success criteria.

  2. 2

    Run the suite and inspect failures alongside their transcripts.

  3. 3

    Test revisions again or configure an experiment with a control and a chosen metric.

Read this before you start

Evaluation runs use models and consume credits. Simulated conversations and scores are evidence for review, not proof of real-world performance. Experiment assignment must be integrated into your calling workflow.

Create an account, then open Agent testing & quality in the console.