Test Synthflow Agents
Sync Synthflow workflows and validate agent performance. Auto-generate test scenarios from your prompt, monitor call logs, and run tests with transcripts, recordings, and 50+ quality metrics.
Hamming works with
Time to value
First test report in under 10 minutes
Connect your provider, sync your agents, and validate real calls in one workflow.
Add your Synthflow API key in Hamming.
Run sync to pull agents and workflow updates.
Confirm call logs appear in Monitoring > Calls.
What you need
- Synthflow API key from the dashboard.
- Configured Synthflow agent or workflow.
Connect in minutes
- 1Add Synthflow key in Agents > Providers.
- 2Run sync to pull agents.
- 3Launch a test run and verify call logs.
Validation checklist
Confirm the integration is working before scaling your tests.
- Provider shows Connected in Agents > Providers.
- Agents appear in Agents > List with the provider badge.
- A test run produces transcripts and audio in the run summary.
- Monitoring > Calls shows Synthflow call logs after tests.
Provider-specific capabilities
Built for Synthflow teams
Provider-aware testing and monitoring without changing your stack.
Keep Synthflow workflows aligned with every sync.
Confirm call logs in Monitoring > Calls after each run.
Test Synthflow agents across PSTN workflows.
50+ quality metrics
What we measure
Comprehensive evaluation across accuracy, conversation quality, voice performance, and task completion.
Accuracy & Correctness
- Factual accuracy
- Intent recognition
- Response relevance
- Hallucination detection
Conversation Quality
- Turn-taking flow
- Interruption handling
- Context retention
- Conversation completion
Voice & Audio
- Latency (time to first word)
- Speech clarity
- Background noise handling
- Accent robustness
Task Completion
- Tool call success rate
- API integration reliability
- Goal completion rate
- Error recovery
Independent evaluation
Why vendor-neutral testing?
Get unbiased results with consistent metrics across all providers—not self-reported scores from your vendor.
| Aspect | Provider built-in testing | Hamming |
|---|---|---|
| Objectivity | Optimized for their platform | Vendor-neutral evaluation |
| Consistency | Metrics vary by provider | Same 50+ metrics across all providers |
| Cross-vendor comparison | Can't compare across vendors | A/B test agents across any provider |
| Independence | Self-reported results | Third-party validation |
| Compliance | Limited audit trail | SOC 2 certified, audit-ready reports |
| Scale | Playground-level testing | 1000+ concurrent production tests |
What you get with Hamming
- Auto-generate test cases and assertions from your prompt.
- Pull tool call data, transcripts, and recordings directly from your provider.
- Run your first test in under 10 minutes with 50+ built-in metrics quality metrics.
- Test both voice and chat agents with unified evaluation.
Frequently Asked Questions
Everything you need to know about testing Synthflow agents with Hamming.
Add your Synthflow API key in Hamming, sync your workflows, and run tests. Hamming monitors call logs in the Monitoring > Calls view and evaluates with 50+ quality metrics.
Yes. Hamming tests Synthflow agents across PSTN workflows including inbound and outbound calls. All test calls appear in your call logs for review.
Run sync from the Agents > Providers page to pull agents and workflow updates. Hamming keeps Synthflow configurations aligned with every sync operation.
Hamming captures transcripts, recordings, and call metadata from every Synthflow test. View logs in Monitoring > Calls and export data for analysis.
Most teams complete setup in under 10 minutes: add API key, run sync, launch a test. No implementation project or infrastructure changes required.
Yes. Hamming tests Synthflow agents with custom actions, CRM integrations, and third-party tools. Verify that external API calls, data lookups, and workflow triggers execute correctly during test scenarios.
Hamming measures end-to-end latency for Synthflow agents including voice-to-voice response time, API call duration, and workflow execution speed. Identify bottlenecks across your entire conversation pipeline.
Yes. Test Synthflow agents across inbound calls, outbound campaigns, transfer scenarios, and IVR flows. Hamming validates behavior consistency across all Synthflow-supported call types and workflows.