Repeatable scenarios
Create an evaluation suite for an agent with caller personas, opening lines and success criteria. Include normal requests and difficult boundaries.
A prompt change deserves more than a quick listen. Build repeatable evaluation cases, inspect the results and compare variants against a metric you choose in advance.

Simulated example
Write the case
Example case / A caller asks to speak to a person.
Run the call
A simulated caller follows its persona while the agent answers.
Read the assertions
Each assertion is checked against the transcript and marked pass or fail.
In the console
Replay every scripted caller in a suite, open the case that failed to see which assertion broke and why, then record the winning variant of a live experiment.
Evaluate scripted cases, score conversations and compare agent variants.
Create an evaluation suite for an agent with caller personas, opening lines and success criteria. Include normal requests and difficult boundaries.
Read the transcript and per-assertion result for each case instead of relying only on a summary pass count.
Use scorecards to define your quality criteria and inspect the breakdown for a conversation or evaluation run.
Configure experiment arms and traffic splits, assign callers through the experiment API and read results against a selected metric. Organize specialized agents into squads where supported.

Step through one simulated evaluation. Pick a case, advance the conversation, then reveal what each assertion found.
Evaluation suite
Simulated example — eval runs use models and consume credits in the real product.
Choose an agent and write representative test cases with explicit success criteria.
Run the suite and inspect failures alongside their transcripts.
Test revisions again or configure an experiment with a control and a chosen metric.
Evaluation runs use models and consume credits. Simulated conversations and scores are evidence for review, not proof of real-world performance. Experiment assignment must be integrated into your calling workflow.
Create an account, then open Agent testing & quality in the console.
Need a system connected first? Browse the integrations directory