Research Engineer, Scalable Foundation Model Training

Together Computer Inc; San Francisco (CA); On-site; USD 200,000 - 290,000; Full time

Benefits offered by this job

Health insurance

Startup equity

Job summary

Together AI in San Francisco is seeking a Research Engineer to turn cutting-edge research on efficient foundation model training into robust, high-performance systems. You will optimize the training infrastructure, profile bottlenecks, and implement state-of-the-art techniques for production environments.

You will work closely with Research Scientists to deploy open-source models on the platform and build experimental infrastructure that accelerates research while delivering reliable, scalable

Qualifications

• Independently take ambiguous performance or infrastructure problems from investigation through deployment.
• Strong programming in Python and PyTorch, with efficient, maintainable code.
• Hands-on experience training or fine-tuning large neural networks in multi-GPU or multi-node environments.
• Solid understanding of ML systems fundamentals, including GPU architecture, mixed-precision training, and distributed training paradigms.
• Strong communication skills and the ability to collaborate with researchers and engineers.
• Passion for staying current with advances in AI research and applying them to production systems.
• Excitement translating cutting-edge research into production systems that deliver customer impact.

Responsibilities

• Design, implement, and optimize core components of Together's large-scale training infrastructure.
• Integrate new model architectures, validate training correctness and convergence, and optimize performance for production fine-tuning workloads.
• Profile distributed training workloads to identify bottlenecks across compute, memory, and communication.
• Design and execute experiments to validate performance hypotheses and benchmark new approaches against state-of-the-art methods.
• Partner closely with Research Scientists to productionize novel training methods and contribute to publications and open-source releases.
• Rapidly enable support for newly released open-source foundation models on the Together platform.
• Build and maintain experimental infrastructure that accelerates research while ensuring production-quality reliability and scalability.

Skills

Python

PyTorch

Distributed training

GPU optimization

Research-to-production

Communication

Tools

CUDA

Triton

NCCL

NVSHMEM

DeepSpeed

Megatron-LM

Job description

Together AI in San Francisco is seeking a Research Engineer to turn cutting-edge research on efficient foundation model training into robust, high-performance systems. You will optimize the training infrastructure, profile bottlenecks, and implement state-of-the-art techniques for production environments.

You will work closely with Research Scientists to deploy open-source models on the platform and build experimental infrastructure that accelerates research while delivering reliable, scalable