ML Platform Lead - LLM Training & Inference

Scale AI; York and North Yorkshire; On-site; GBP 120,000 - 180,000; Full time

Benefits offered by this job

Health & Wellbeing

Career Growth stipend

Community events

Parental Support

Job summary

Scale AI is seeking a software engineer to build and optimize our large-scale training and inference platform. You will work with ML researchers and engineers to accelerate R&D and enable next-generation LLM training, evaluation, and data curation.

You will contribute to a distributed ML system stack, profile performance, and collaborate across teams to push the frontier of AI infrastructure.

Qualifications

• Strong software engineering skills with distributed systems experience.
• Experience with CUDA, PyTorch, transformers and related tools.
• Experience with post-training methods such as RLHF/RLVR and related algorithms.
• Excellent communication across cross-functional teams.

Responsibilities

• Build, profile and optimize our training and inference framework.
• Collaborate with ML and research teams to accelerate R&D and enable next-gen models.
• Research and integrate state-of-the-art technologies to optimize our ML system.

Skills

Strong software engineering

Distributed systems

Cross-functional collaboration

Tools

CUDA

PyTorch

Transformers

Flash attention

Job description

Scale AI is seeking a software engineer to build and optimize our large-scale training and inference platform. You will work with ML researchers and engineers to accelerate R&D and enable next-generation LLM training, evaluation, and data curation.

You will contribute to a distributed ML system stack, profile performance, and collaborate across teams to push the frontier of AI infrastructure.