LLM Systems Engineer & Research

Scale AI, Inc.; New York (NY); On-site; USD 189,600 - 237,000; Full time

Benefits offered by this job

Comprehensive health coverage

Dental and vision coverage

Retirement benefits

Learning and development stipend

Generous PTO

Commuter stipend

Job summary

Scale AI, Inc. in New York is seeking a talented individual to build and optimize their training and inference framework as part of their ML platform team. In this role, you'll collaborate with various teams to enhance research and development capabilities while integrating advanced technologies.

The ideal candidate will have a strong background in system optimization and experience with distributed ML systems, along with excellent software engineering skills. Scale offers competitive salaries along with comprehensive benefits including health, dental, and retirement plans.

Qualifications

• Strong excitement about system optimization.
• Experience with multi-node LLM training and inference.
• Strong software engineering skills, proficient in frameworks and tools.

Responsibilities

• Build, profile and optimize our training and inference framework.
• Collaborate with ML teams to accelerate their research and development.
• Research and integrate state-of-the-art technologies.

Skills

System optimization

Multi-node LLM training

Large-scale distributed ML systems

CUDA

Pytorch

Transformers

Flash attention

Written and verbal communication

Job description

Scale AI, Inc. in New York is seeking a talented individual to build and optimize their training and inference framework as part of their ML platform team. In this role, you'll collaborate with various teams to enhance research and development capabilities while integrating advanced technologies.

The ideal candidate will have a strong background in system optimization and experience with distributed ML systems, along with excellent software engineering skills. Scale offers competitive salaries along with comprehensive benefits including health, dental, and retirement plans.