Open-Source ML Platform Engineer

Together Computer Inc; San Francisco (CA); On-site; USD 180,000 - 280,000; Full time

Job summary

Together AI in San Francisco is seeking a Research Engineer for Post-Training Inference to build a platform that lets developers tailor open-source models with their data. You will work across post-training, fine-tuning, RL, and evaluation to production serving and optimize the inference engine for large-scale experiments.

You'll collaborate with product, research, and engineering teams to keep the API reliable, performant, and deeply integrated into our infrastructure, advancing open-source AI

Qualifications

• 2+ years of experience building and deploying ML-based services in a production environment.
• Hands-on experience with modern inference engines, such as SGLang, vLLM, and TensorRT-LLM.
• Familiar with the latest methods for fine-tuning LLMs and other AI models.
• Strong software engineering background in Python or Go.
• Stay up to date with the latest advances and trends in ML.

Responsibilities

• Design and build Together’s systems for customizing open-source models.
• Build integrations between the Model Shaping and Inference platforms to ensure a seamless path from post-training to serving production workloads.
• Add features to inference engines for large-scale post-training experiments, including optimizations for RL workloads.
• Make sure the service is stable and robust, participating in an on-call rotation and ensuring 24/7 availability of our platform.

Skills

ML in prod

Python/Go

System design

Open-source ML

Tools

SGLang

vLLM

TensorRT-LLM

CUDA

Job description

Together AI in San Francisco is seeking a Research Engineer for Post-Training Inference to build a platform that lets developers tailor open-source models with their data. You will work across post-training, fine-tuning, RL, and evaluation to production serving and optimize the inference engine for large-scale experiments.

You'll collaborate with product, research, and engineering teams to keep the API reliable, performant, and deeply integrated into our infrastructure, advancing open-source AI