Voice AI Inference Engineer — Real-Time Platform

Baseten; Seattle (WA); On-site; USD 165,000 - 330,000; Full time

Benefits offered by this job

Health insurance

Flexible PTO

Parental leave

Fertility and family-building stipend

401(k)

Job summary

Baseten is building Voice AI, and you’ll own the in-house inference stack from roadmap to production, powering real-time STT, TTS, and voice agent workloads across productivity, customer service, and education. You’ll optimize latency, throughput, and reliability while collaborating with a broad set of teams to ship high-impact features.

As the owner, you’ll partner with Forward Deployed Engineers and sister teams to push the boundaries of Voice AI, mentor teammates, and ensure scalable

Qualifications

• Bachelor's degree in Computer Science or related field.
• Proven track record owning production-grade real-time, large-scale systems where tail latency (p99) matters.
• Proficient coding abilities in one or more popular programming or scripting languages; Python proficiency is a plus.

Responsibilities

• Own and lead Voice AI product areas end-to-end - from architecture and system design through implementation, rollout, and long-term production operations.
• Design, build, and operate real-time, large-scale, high-performance model serving systems for STT, TTS, and voice agent workloads for mission-critical customer deployments
• Drive cross-team collaboration with sister engineering teams to solve full-stack technical problems, align on priorities, and coordinate end-to-end delivery across the product surface area
• Mentor teammates through code reviews, design docs, and technical leadership.

Skills

Python

Real-time systems

Collaboration

AI infrastructure

Education

Bachelor's degree in Computer Science or related field

Tools

Docker

Kubernetes

TensorRT

ONNX

vLLM

Job description

Baseten is building Voice AI, and you’ll own the in-house inference stack from roadmap to production, powering real-time STT, TTS, and voice agent workloads across productivity, customer service, and education. You’ll optimize latency, throughput, and reliability while collaborating with a broad set of teams to ship high-impact features.

As the owner, you’ll partner with Forward Deployed Engineers and sister teams to push the boundaries of Voice AI, mentor teammates, and ensure scalable