ML Systems Engineer - Scalable Training & Inference

Scale AI, Inc.; New York (NY); On-site; USD 189,600 - 237,000; Full time

Benefits offered by this job

Equity

Benefits

Commuter stipend

Job summary

Scale AI, Inc. is building and optimizing a distributed platform to support next-generation LLM training, inference, and data curation. You will work across ML teams to shape our foundation platform for Scale's continued AI research and development.

The role emphasizes system optimization, multi-node training experience, and strong software engineering using CUDA, PyTorch, Transformers, and related tools; cross-functional collaboration is essential.

Qualifications

• Experience with multi-node LLM training and inference.
• Experience developing large-scale distributed ML systems.
• Strong software engineering skills with modern ML frameworks.

Responsibilities

• Build, profile and optimize our training and inference framework.
• Collaborate with ML teams to accelerate research and development and enable next-generation models and data curation.
• Research and integrate state-of-the-art technologies to optimize our ML system.

Skills

System optimization

Multi-node training

Distributed ML systems

Cross-functional collaboration

Communication

Tools

CUDA

PyTorch

Transformers

Flash attention

Job description

Scale AI, Inc. is building and optimizing a distributed platform to support next-generation LLM training, inference, and data curation. You will work across ML teams to shape our foundation platform for Scale's continued AI research and development.

The role emphasizes system optimization, multi-node training experience, and strong software engineering using CUDA, PyTorch, Transformers, and related tools; cross-functional collaboration is essential.