Staff ML Engineer, Voice AI - Real-Time Inference Lead

Together AI; San Francisco (CA); On-site; USD 220,000 - 280,000; Full time

Benefits offered by this job

Health insurance

Startup equity

Competitive benefits

Job summary

Together AI in San Francisco is seeking a Staff Machine Learning Engineer for voice AI applications. This role includes owning the model serving stack, leading productionization, and optimizing performance for voice workloads.

Ideal candidates will have over 8 years of experience in ML engineering and expertise with LLM serving engines. Strong Python skills are essential, as well as a deep understanding of GPU optimization. Competitive compensation and equity are offered.

Qualifications

• 8+ years of ML engineering experience focused on model serving.
• Expert knowledge of LLM serving engines like TensorRT-LLM.
• Strong Python and PyTorch skills with GPU optimization.

Responsibilities

• Own the voice inference roadmap and define technical strategies.
• Drive inference performance and architect systems for voice workloads.
• Lead productionization of voice models at scale.

Skills

ML engineering experience

Model serving expertise

LLM serving engines

Python proficiency

GPU optimization

System design judgment

Technical leadership

Speech ML knowledge

Education

Bachelor's or Master's in Computer Science or related field

Job description

Together AI in San Francisco is seeking a Staff Machine Learning Engineer for voice AI applications. This role includes owning the model serving stack, leading productionization, and optimizing performance for voice workloads.

Ideal candidates will have over 8 years of experience in ML engineering and expertise with LLM serving engines. Strong Python skills are essential, as well as a deep understanding of GPU optimization. Competitive compensation and equity are offered.