Hamming Logo
×
Partner Logo

Hamming enables Lilac Labs to proactively deliver accurate and efficient AI drive-thru ordering

Lilac Labs, a pioneer in Quick Service Restaurant (QSR) automation, leverages Hamming to ensure their AI voice agents provide seamless and reliable ordering experiences.

Prior attempts at drive-thru automation often failed due to high costs and poor performance. With Hamming, Lilac Labs tests and refines their voice agents across thousands of real-world scenarios, ensuring they handle background noise, complex orders, and upselling opportunities with ease.

Company Logo
Location
United States
Industry
Quick Service Restaurants
Company Size
Scaling Nationwide

Use Cases:

  • Automated AI voice agent testing
  • Real-world scenario validation
  • Production call analytics

Customer Challenge

Shelden Shi

The Challenge: Manual Voice Agent Testing

Co-Founder & CTO @ Lilac Labs

We automate the person taking orders at the drive-thru with voice. Order accuracy is extremely critical for our customers. Getting an order wrong (i.e., missing allergies) means significant financial loss.

Before we had Hamming, we were spending hours per day calling our system by hand. Every time we changed our prompts or function definitions, we would need to retest our system to make sure it still worked and didn't break anything.

How Hamming Solved Automated AI Voice Agent Testing

Solution Steps

Step 1: Creating Comprehensive Test Scenarios

We worked closely with the team at Lilac to create 1000s of characters and scenarios that mimic how real customers order food - paying attention to the details like dietary restrictions, allergies, and preferences.

We also created an array of LLM judges that scored the performance of their voice agents for each scenario.

Scenarios and LLM Judges

Step 2: Automated AI Voice Agent Testing at Scale

Now, instead of testing voice agents by hand, the team at Lilac could press a button and have our system make 1000s of concurrent calls to their voice agents.

For each phone call, the team had detailed analytics on where their system needed more work.

See more details on our approach here.

Voice Agent Testing Demo

Step 3: Real-time Production Monitoring

In production, we gave the team full visibility into how users were interacting with their AI voice agents in production and flagged cases where their agents were struggling.

The team could easily convert calls and traces into test cases and add them to their golden dataset of scenarios.

See more details on our approach here.

Production Call Analytics

Our agents call your agent

Our voice agents are trained to mimic human conversations, including accents, background noise, and pauses.

For each call, we automatically score the call quality and provide detailed analytics.

Icon 01
Icon 02
Icon 02
Icon 03
Icon 04
Icon 05
Icon 06

In any language

Our AI voice agents can call your agents in any language, including English, French, German, Hindi, Spanish, Italian, and more.

🇺🇸

English

🇫🇷

French

🇩🇪

German

🇮🇳

Hindi

🇪🇸

Spanish

🇮🇹

Italian

Automated AI Voice Agent Testing Saves Time and Money

5K

Scenarios created

130K

Tests run / year

5.2K

Hours saved / year

$520K

Costs saved / year

Customer Testimonial

Tony Kam

Co-Founder & CEO @ Lilac Labs

Hamming helps us simulate 1000s of customer calls (dietary restrictions, allergies, large group orders, etc.) and find gaps in our system in minutes. This gives us a huge peace of mind and clarity on where we need to improve our AI drive through agent.

The Hamming team is ready to jump and help us wherever and whenever we need them. These guys do whatever it takes to deliver.

Hamming is an essential part of our infra that directly unlocks revenue.

Tony Kam
Logo

Ship reliable AI voice agents with confidence