Research Engineer, Scalable Foundation Model Training

Together AI; San Francisco (CA); On-site; USD 200,000 - 290,000; Full time

Benefits offered by this job

Health insurance

Startup equity

Other benefits

Job summary

Together AI is seeking a Research Engineer on the Scaling Team to translate cutting-edge research into robust training systems. You will profile and optimize training infrastructure, identify bottlenecks, and implement techniques from literature and our scientists into production.

You will enable support for open-source foundation models on the Together platform, collaborate with researchers to accelerate experiments, and help deploy validated ideas at scale.

Qualifications

• Ability to independently take ambiguous performance problems from investigation through deployment.
• Strong Python and PyTorch skills, with efficient, maintainable code.
• Hands-on experience training or fine-tuning large neural networks in multi-GPU or multi-node setups.

Responsibilities

• Design, implement, and optimize core components of Together's large-scale training infrastructure.
• Integrate new model architectures, validate training correctness and convergence, and optimize performance for production fine-tuning workloads.
• Profile distributed training workloads to identify and eliminate bottlenecks across compute, memory, and communication.
• Design and execute experiments to validate performance hypotheses and benchmark new approaches against state-of-the-art methods.
• Partner closely with Research Scientists to productionize novel training methods and contribute to publications and open-source releases.
• Rapidly enable support for newly released open-source foundation models on the Together platform.
• Build and maintain experimental infrastructure that accelerates research while ensuring production-quality reliability and scalability.

Skills

Python

PyTorch

Multi-GPU

ML systems

Communication

Productionizing

Tools

CUDA

NCCL

DeepSpeed

Megatron-LM

FSDP

Job description

Together AI is seeking a Research Engineer on the Scaling Team to translate cutting-edge research into robust training systems. You will profile and optimize training infrastructure, identify bottlenecks, and implement techniques from literature and our scientists into production.

You will enable support for open-source foundation models on the Together platform, collaborate with researchers to accelerate experiments, and help deploy validated ideas at scale.