Hamming research
Our research
methodology.
Hamming was first to market with a platform for testing voice agents. Every framework, benchmark, and recommendation we publish is grounded in production data from real voice agent deployments.
- Voice mins protected
- 10M+
- Voice agents
- 10K+
- Platforms tested
- 10+
- Industries served
- 6+
Hamming works with
All integrations
How we conduct
research.
Our research methodology combines automated analysis with expert validation.
- Step 1
Data collection
We collect data from production voice agent deployments and synthetic test calls designed to stress-test edge cases.- Production call recordings from enterprise customers (anonymized)
- Synthetic test calls simulating diverse user behaviors
- A/B comparison data across voice platforms
- Multi-language and multi-accent test scenarios
- Step 2
Analysis approach
We combine automated LLM-as-judge scoring with manual expert review for nuanced failure analysis.- Automated scoring for consistency at scale
- Manual expert review for edge cases and nuanced failures
- Statistical validation across deployment segments
- Regression detection between model versions
- Step 3
Quality standards
All findings are validated across multiple deployments before publication.- Findings validated across 3+ enterprise deployments
- Data anonymized and aggregated for privacy
- Regular methodology review and iteration
- Transparent disclosure of limitations
Hamming's voice agent
performance benchmarks.
These benchmarks draw on Hamming's work across 10M+ mins protected and 10K+ voice agents (2025 to 2026).
Latency benchmarks
| Metric | Excellent | Good | Acceptable |
|---|---|---|---|
| Time to First Word (TTFW) | <300ms | <500ms | <800ms |
| P50 Turn Latency | <1600ms | <1800ms | <2000ms |
| P90 Turn Latency | <2200ms | <2500ms | <3000ms |
| P99 Turn Latency | <3000ms | <3500ms | <4000ms |
Accuracy benchmarks
| Metric | Excellent | Good | Acceptable |
|---|---|---|---|
| ASR Word Error Rate | <5% | <8% | <12% |
| Goal Completion Rate | >90% | >80% | >70% |
| Prompt Adherence | >98% | >95% | Not set |
Reliability benchmarks
| Metric | Excellent | Good | Acceptable |
|---|---|---|---|
| Call Success Rate | >95% | >90% | >85% |
| Escalation Rate | <5% | Not set | Not set |
| Hallucination Rate | <5% | Not set | Not set |
Source: Hamming's work across 10M+ mins protected and 10K+ voice agents (2025 to 2026).
Expert-verified research
See our research
in action.
Explore our guides, frameworks, and benchmarks built on this methodology.