Senior Machine Learning Engineer - Voice Experience

cresta

United States

On-site

USD 140,000 - 230,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Cresta is seeking a Senior Machine Learning Engineer, Voice Experience to advance real-time voice systems for the contact center. You will design and deploy end-to-end ML components for ASR, language understanding, and TTS, partnering with researchers, product managers, and platform engineers.

You will balance model quality with latency and reliability, build evaluation and observability, and help shape Cresta's voice AI roadmap for scalable customer conversations.

Qualifications

  • Academic credentials required; advanced degree preferred.
  • Hands-on production ML experience required.

Responsibilities

  • Design, train, evaluate, and deploy real-time voice ML systems (ASR, NLP, TTS).
  • Improve voice AI quality via error analysis and data curation.
  • Build evaluation frameworks for latency, accuracy, and robustness.
  • Diagnose failures across transcription, retrieval, and prompts.
  • Design low-latency workflows and productionize real-time inference.
  • Collaborate with platform and frontend/backend teams to integrate voice AI.
  • Mentor engineers and contribute to technical strategy.

Skills

Production ML (5+ yrs)
Speech/NLP/AI background
Model evaluation/benchmarking
Real-time latency & reliability

Education

Bachelor's degree in CS/Math/ML/AI
Advanced degree preferred

Tools

PyTorch
TensorFlow
Hugging Face

Job description

Cresta unlocks the true potential of the customer experience, turning every conversation into a competitive advantage. Cresta's unified AI platform combines conversational AI agents, real-time human agent augmentation, and comprehensive conversation intelligence to drive revenue and efficiency gains across every channel. The world's leading companies, including United Airlines, Cox Communications, and Marriott, use Cresta to power world-class customer experiences every day.

Born from the Stanford AI Lab, Cresta has raised more than $270 million from the world's leading investors, including a16z, Greylock, and Sequoia. Cresta's leadership includes some of the leading minds in AI today. Our CEO, Ping Wu , founded and led Google's Contact Center AI and Vertex AI platforms before joining Cresta to build the future of AI-driven customer experiences.

Over the next few years, AI is going to redefine how people all over the world interact with businesses every day. Come build that future at Cresta.

About the role

We are looking for a Senior Machine Learning Engineer, Voice Experience to help build the next generation of AI-powered voice systems for the contact center. In this role, you will work at the intersection of speech, language, and real-time production systems , improving how AI listens, understands, reasons, empathizes, and responds in live customer conversations.

You will develop and improve machine learning systems that power voice experiences end to end, including automatic speech recognition, turn detection, downstream language understanding, retrieval-augmented and agentic workflows, quality measurement, text to speech, and production optimization . You will partner closely with applied researchers, product managers, designers, forward deployed engineers, and platform engineers to ensure model and system improvements translate into measurable customer and business impact.

This role is ideal for someone who is excited by both model quality and production reality : designing rigorous evaluation frameworks, analyzing failure modes, improving latency and robustness, and shipping systems that perform reliably at scale in real-time voice environments.

Responsibilities
  • Design, train, evaluate, and deploy machine learning systems that power real-time voice experiences, including ASR, speech understanding, turn detection, text to speech, speech to speech, classification, entity extraction, summarization, and structured insight generation.
  • Improve the quality of voice AI systems through error analysis, data curation, metric design, benchmarking, and iterative model improvement, with a strong focus on real-world performance.
  • Build evaluation frameworks for complex voice and agentic systems, measuring metrics such as accuracy, robustness, latency, faithfulness, naturalness, professionalism, task completion, and cost.
  • Diagnose and mitigate failure modes across the voice stack, including transcription errors, hallucinations, retrieval failures, tool misuse, prompt brittleness, context drift, and multi-step reasoning breakdowns.
  • Design and optimize low-latency ML workflows for live conversations, balancing model quality with system responsiveness, scalability, and reliability.
  • Partner with platform and backend engineers to productionize real-time inference, streaming pipelines, quality monitoring, and continuous model iteration.
  • Collaborate cross-functionally with product, design, frontend, and backend teams to integrate voice intelligence seamlessly into Cresta's platform.
  • Establish best practices for offline evaluation, online experimentation, model validation, observability, and ongoing quality monitoring in production.
  • Mentor engineers, contribute to technical strategy, and help shape the roadmap for Cresta's voice AI systems.
Qualifications We Value
  • Bachelor's degree in Computer Science, Mathematics, Machine Learning, AI, or a related field; Master's or Ph.D. preferred.
  • 5+ years of experience building, evaluating, and deploying machine learning systems in production.
  • Strong background in one or more of the following: speech recognition, speech processing, NLP, generative AI, or conversational AI .
  • Deep experience with model evaluation, benchmarking, error analysis, and quality improvement for production ML systems.
  • Strong expertise with modern ML frameworks and tooling such as PyTorch, TensorFlow, and Hugging Face.
  • Solid understanding of transformer-based models, embeddings, retrieval systems, and large-scale training or inference workflows.
  • Experience designing and deploying real-time ML systems with strong requirements around latency, scalability, and reliability.
  • Experience building data pipelines and tooling for experimentation, measurement, and large-scale quality analysis.
  • Ability to work across research and engineering boundaries and translate promising ideas into production-grade systems.
  • Strong communication and technical leadership skills, with the ability to influence cross
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Engineer - AI Agent Voice Experience
Lead Engineer - AI Agent Voice Experience

Cresta • United States

Remote
USD 150,000 - 210,000
Lead Engineer - AI Agent Voice Experience
Lead Engineer - AI Agent Voice Experience

FDE Times • United States

Remote
USD 205,000 - 270,000
Comprehensive medical, dental, and vis
Flexible PTO
Parental leave
+3
Senior Machine Learning Engineer - Voice Experience
Senior Machine Learning Engineer - Voice Experience

Cresta • United States

Remote
USD 205,000 - 270,000
Comprehensive medical, dental, and vision coverage
Flexible PTO
Paid parental leave
+4
Senior Voice AI Engineer - Real-Time Production ML
Senior Voice AI Engineer - Real-Time Production ML

cresta • United States

On-site
USD 140,000 - 230,000
Lead Engineer - AI Agent Voice Experience
Lead Engineer - AI Agent Voice Experience

Devconnectplatform • United States

Remote
USD 205,000 - 270,000
Medical/dental/vision coverage
Flexible PTO
Parental leave
+4
Applied Data Scientist
Applied Data Scientist

Cresta • United States

Remote
USD 110,000 - 170,000
AI Strategist
AI Strategist

FDE Times • United States

Remote
USD 150,000 - 200,000
Comprehensive medical, dental, and vis
Flexible PTO
Parental leave
+4
Senior Machine Learning Engineer
Senior Machine Learning Engineer

FDE Times • United States

Remote
USD 205,000 - 270,000
Medical coverage
Dental coverage
Vision coverage
+6
Senior Full Stack Engineer - Conversation Intelligence
Senior Full Stack Engineer - Conversation Intelligence

Cresta • United States

Hybrid
USD 140,000 - 190,000
Comprehensive medical, dental, and dim
Flexible PTO
Paid parental leave
+4
Principal Solutions Engineer, West
Principal Solutions Engineer, West

Big Internet Seller Services Inc • United States

Remote
USD 220,000 - 275,000
Comprehensive medical, dental, and vis
Flexible PTO
Parental leave
+4