LLM Training & Inference Systems Engineer

United States Digital Space LLC; New York, San Francisco (NY, CA); On-site; USD 190,000 - 237,000; Full time

Job summary

Scale is seeking engineers to build and optimize our ML platform for large language model training and inference. You will collaborate with ML researchers to accelerate development and integra te state-of-the-art technologies for scalable ML systems.

You will contribute to a foundation platform that supports LLM training, inference, and data curation, shaping the future of AI through innovative engineering and cross-team collaboration.

Qualifications

• Strong excitement about system optimization.
• Experience with multi-node LLM training and inference.
• Experience with developing large-scale distributed ML systems.
• Strong written and verbal communication skills and the ability to operate in a cross functional team environment.
• Nice to have: expertise in post-training methods and/or next generation use cases for large language models.

Responsibilities

• Build, profile and optimize our training and inference framework
• Collaborate with ML teams to accelerate their research and development and enable them to develop the next generation of models and data curation
• Research and integrate state-of-the-art technologies to optimize our ML system

Skills

Distributed ML systems

Multi-node training

Model training/inference

Cross-functional communication

System optimization

Tools

CUDA

PyTorch

Transformers

Flash Attention

Job description

Scale is seeking engineers to build and optimize our ML platform for large language model training and inference. You will collaborate with ML researchers to accelerate development and integra te state-of-the-art technologies for scalable ML systems.

You will contribute to a foundation platform that supports LLM training, inference, and data curation, shaping the future of AI through innovative engineering and cross-team collaboration.