Lead Voice AI Engineer — Real-Time Inference

Rozgoo; United States; Remote; USD 180,000 - 280,000; Full time

Benefits offered by this job

Competitive equity package

100% medical, dental & vision coverage

Flexible PTO with Winter Break

Paid parental leave

Fertility & family-building stipend

Exposure to ML startups

Job summary

Baseten is seeking a high-impact leader to own and drive Baseten Voice AI, our in-house inference stack for real-time voice processing. You will guide architecture, implement scalable serving for STT and TTS, and push production readiness across teams.

You will collaborate with Forward Deployed Engineers and sister teams, mentor peers, and shape the roadmap for production-grade voice capabilities used by diverse customers. A strong systems background and Python fluency are essential.

Qualifications

• Bachelor's degree or higher in Computer Science or related field.
• Proven track record owning production-grade real-time, large-scale systems where tail latency (p99) matters.
• Proficient coding abilities in one or more popular programming languages; Python proficiency is a plus.
• Good taste in product, particularly developer-oriented tools.
• Interest in ML/AI infrastructure and willingness to learn.
• Strong collaboration and communication skills.

Responsibilities

• Own and lead Voice AI product areas end-to-end - from architecture and system design through implementation, rollout, and long-term production operations.
• Design, build, and operate real-time, large-scale, high-performance model serving systems for STT, TTS, and voice agent workloads for mission-critical customer deployments.
• Drive cross-team collaboration with sister engineering teams to solve full-stack technical problems, align on priorities, and coordinate end-to-end delivery across the product surface area.
• Mentor teammates through code reviews, design docs, and technical leadership.

Skills

Real-time systems

Tail latency

Python

Distributed systems

Cross-team collaboration

Education

Bachelor's degree in Computer Science or related field

Tools

Docker

Kubernetes

PyTorch Profiler

ONNX

Job description

Baseten is seeking a high-impact leader to own and drive Baseten Voice AI, our in-house inference stack for real-time voice processing. You will guide architecture, implement scalable serving for STT and TTS, and push production readiness across teams.

You will collaborate with Forward Deployed Engineers and sister teams, mentor peers, and shape the roadmap for production-grade voice capabilities used by diverse customers. A strong systems background and Python fluency are essential.