LLM Platform Lead — Scalable Training & Inference

Scale AI, Inc.; New York (NY); On-site; USD 264,800 - 331,000; Full time

Benefits offered by this job

Comprehensive health, dental and vision coverage

Retirement benefits

Learning and development stipend

Generous PTO

Commuter stipend

Job summary

Scale AI, Inc. in New York is looking for a Machine Learning Engineer to build and optimize our training and inference framework for large language models. The role demands collaboration with various ML teams to accelerate research and development, employing advanced technologies in machine learning.

Ideal candidates should have experience in large-scale distributed ML systems and a strong foundation in systems optimization. We offer competitive compensation packages with comprehensive benefits including health coverage and generous PTO.

Qualifications

• Passionate about system optimization.
• Strong software engineering skills.
• Experience with next-generation ML methods.

Responsibilities

• Build, profile, and optimize training and inference framework.
• Collaborate with ML teams for research acceleration.
• Research and integrate state-of-the-art technologies.

Skills

System optimization

Multi-node LLM training and inference

Distributed ML systems development

Post-training methods (RLHF, PPO)

Software engineering (CUDA, Pytorch)

Communication skills

Tools

CUDA

Pytorch

Transformers

Flash attention

Job description

Scale AI, Inc. in New York is looking for a Machine Learning Engineer to build and optimize our training and inference framework for large language models. The role demands collaboration with various ML teams to accelerate research and development, employing advanced technologies in machine learning.

Ideal candidates should have experience in large-scale distributed ML systems and a strong foundation in systems optimization. We offer competitive compensation packages with comprehensive benefits including health coverage and generous PTO.