Test Synthflow agents
- Time to value
- First test report in under 10 minutes
- Setup
- 3 steps
First test report in under 10 minutes
Connect your provider, sync your agents, and validate real calls in one workflow.
- 01
Connect Synthflow
Add your Synthflow API key in Hamming. - 02
Sync workflows
Run sync to pull agents and workflow updates. - 03
Run a test
Confirm call logs appear in Monitoring > Calls.
What you need
- Synthflow API key from the dashboard.
- Configured Synthflow agent or workflow.
Connect in minutes
- 01Add Synthflow key in Agents > Providers.
- 02Run sync to pull agents.
- 03Launch a test run and verify call logs.
Validation checklist.
Confirm the integration works before you scale your tests.
- Provider shows Connected in Agents > Providers.
- Agents appear in Agents > List with the provider badge.
- A test run produces transcripts and audio in the run summary.
- Monitoring > Calls shows Synthflow call logs after tests.
Built for Synthflow teams.
Provider-aware testing and monitoring, without changing your stack.
Flow-based sync
Keep Synthflow workflows aligned with every sync.Monitoring-first validation
Confirm call logs in Monitoring > Calls after each run.PSTN coverage
Test Synthflow agents across PSTN workflows.
What we measure.
50+ quality metrics across accuracy, conversation quality, voice performance, and task completion.
Accuracy & Correctness
- Factual accuracy
- Intent recognition
- Response relevance
- Hallucination detection
Conversation Quality
- Turn-taking flow
- Interruption handling
- Context retention
- Conversation completion
Voice & Audio
- Latency (time to first word)
- Speech clarity
- Background noise handling
- Accent robustness
Task Completion
- Tool call success rate
- API integration reliability
- Goal completion rate
- Error recovery
Why vendor-neutral
testing?
The same metrics across every provider, instead of scores your vendor reports about itself.
| Aspect | Provider built-in testing | Hamming |
|---|---|---|
| Objectivity | Provider built-in testingOptimized for their platform | HammingVendor-neutral evaluation |
| Consistency | Provider built-in testingMetrics vary by provider | HammingSame 50+ metrics across all providers |
| Cross-vendor comparison | Provider built-in testingCan't compare across vendors | HammingA/B test agents across any provider |
| Independence | Provider built-in testingSelf-reported results | HammingThird-party validation |
| Compliance | Provider built-in testingLimited audit trail | HammingSOC 2 certified, audit-ready reports |
| Scale | Provider built-in testingPlayground-level testing | Hamming50K+ concurrent test calls |
What you get
with Hamming.
- Auto-generate test cases and guardrails from your prompt.
- Pull tool call data, transcripts, and recordings directly from your provider.
- Run your first test in under 10 minutes with 50+ built-in metrics.
- Test both voice and chat agents with unified evaluation.
Frequently asked
questions.
Everything you need to know about testing Synthflow agents with Hamming.
Browse every answer on the FAQ pageAdd your Synthflow API key in Hamming, sync your workflows, and run tests. Hamming monitors call logs in the Monitoring > Calls view and evaluates with 50+ quality metrics.
Yes. Hamming tests Synthflow agents across PSTN workflows including inbound and outbound calls. All test calls appear in your call logs for review.
Run sync from the Agents > Providers page to pull agents and workflow updates. Hamming keeps Synthflow configurations aligned with every sync operation.
Hamming captures transcripts, recordings, and call metadata from every Synthflow test. View logs in Monitoring > Calls and export data for analysis.
Most teams complete setup in under 10 minutes: add API key, run sync, launch a test. No implementation project or infrastructure changes required.
Yes. Hamming tests Synthflow agents with custom actions, CRM integrations, and third-party tools. Verify that external API calls, data lookups, and workflow triggers execute correctly during test scenarios.
Hamming measures end-to-end latency for Synthflow agents including voice-to-voice response time, API call duration, and workflow execution speed. Identify bottlenecks across your entire conversation pipeline.
Yes. Test Synthflow agents across inbound calls, outbound campaigns, transfer scenarios, and IVR flows. Hamming validates behavior consistency across all Synthflow-supported call types and workflows.