Senior ML Systems Engineer: Scalable Training Frameworks

Cohere; San Francisco (CA); Hybrid; USD 150,000 - 180,000; Full time

Benefits offered by this job

Inclusive culture

Weekly lunch stipend

Health and dental benefits

100% Parental Leave top-up

Personal enrichment benefits

Remote-flexible work

6 weeks of vacation

Job summary

A leading AI research firm located in San Francisco is seeking a Senior ML Systems Engineer to build and maintain the training framework for large-scale language models. The role involves designing distributed training solutions and improving training throughput across multi-node clusters. The ideal candidate will have strong engineering experience in distributed training, familiarity with JAX, and excellent collaboration skills. This position promises significant ownership over critical components and engagement with cutting-edge AI technologies while offering a flexible work environment.

Qualifications

• Strong engineering experience in large-scale distributed training or HPC systems.
• Experience with multi-node cluster orchestration.
• Comfort debugging performance issues across the ML systems stack.

Responsibilities

• Build and own the training framework for large-scale LLM training.
• Design distributed training abstractions.
• Improve training throughput on multi-node clusters.

Skills

Large-scale distributed training

HPC systems

Performance debugging

Containerized environments

Collaboration skills

Tools

JAX

CUDA/NCCL

Docker

Kubernetes

Job description

A leading AI research firm located in San Francisco is seeking a Senior ML Systems Engineer to build and maintain the training framework for large-scale language models. The role involves designing distributed training solutions and improving training throughput across multi-node clusters. The ideal candidate will have strong engineering experience in distributed training, familiarity with JAX, and excellent collaboration skills. This position promises significant ownership over critical components and engagement with cutting-edge AI technologies while offering a flexible work environment.