Senior ML Engineer, Voice AI — Real-Time Inference at Scale

Together AI; San Francisco (CA); On-site; USD 200,000 - 260,000; Full time

Benefits offered by this job

Competitive salary

Startup equity

Health insurance

Other competitive benefits

Job summary

An innovative AI company in San Francisco is seeking a Senior Machine Learning Engineer for Voice AI to optimize voice model inference and productionize cutting-edge voice applications. The ideal candidate will have over 5 years of ML engineering experience, strong Python and PyTorch skills, and hands-on expertise with model serving engines. This role offers competitive compensation, equity, and the opportunity to be part of a high-impact team in a fast-growing product space.

Qualifications

• 5+ years of experience in ML engineering with a focus on model serving and optimization.
• Hands-on experience with LLM serving engines.
• Strong proficiency in Python and PyTorch.

Responsibilities

• Optimize inference performance for voice models targeting best latency and throughput.
• Productionize voice models on serverless and dedicated endpoints.
• Build and maintain a voice model evaluation framework.

Skills

Model serving and inference optimization

Python

PyTorch

GPU profiling

Audio signal processing

Education

Bachelor's or Master's degree in Computer Science, Electrical Engineering, or related field

Tools

LLM serving engines (vLLM, SGLang, TensorRT-LLM)

CUDA

Job description

An innovative AI company in San Francisco is seeking a Senior Machine Learning Engineer for Voice AI to optimize voice model inference and productionize cutting-edge voice applications. The ideal candidate will have over 5 years of ML engineering experience, strong Python and PyTorch skills, and hands-on expertise with model serving engines. This role offers competitive compensation, equity, and the opportunity to be part of a high-impact team in a fast-growing product space.