Staff ML Systems Engineer, Core Inference

Together AI; San Francisco (CA); On-site; USD 200,000 - 280,000; Full time

Benefits offered by this job

Startup equity

Health insurance

Competitive benefits

Job summary

A research-driven AI company in the U.S. offers a role in research engineering. The position involves translating RL algorithms into production-grade systems with a focus on inference performance. Candidates need a strong foundation in ML systems, and experience with RL and high-performance computing is advantageous. The compensation package includes a salary range of $200,000 - $280,000 plus equity and benefits, emphasizing technical leadership and innovative solutions in AI infrastructure.

Qualifications

• 3+ years of experience in ML systems or equivalent.
• Track record of impactful work in ML systems, RL, or large-scale model training.

Responsibilities

• Design and prototype algorithms for inference.
• Profile and optimize performance across GPU and memory layers.
• Own critical systems at production scale.

Skills

Implementation and shipping bias

RL / post-training for LLMs

Model architecture design

Strong coding ability in Python

Experience in ML systems

Education

Advanced degree in Computer Science, EE, or related field

Tools

Distributed systems

High-performance computing

Job description

A research-driven AI company in the U.S. offers a role in research engineering. The position involves translating RL algorithms into production-grade systems with a focus on inference performance. Candidates need a strong foundation in ML systems, and experience with RL and high-performance computing is advantageous. The compensation package includes a salary range of $200,000 - $280,000 plus equity and benefits, emphasizing technical leadership and innovative solutions in AI infrastructure.