Senior ML Systems Engineer: Frameworks & Tooling (Remote)

Cohere; Montreal; On-site; CAD 100,000 - 140,000; Full time

Benefits offered by this job

Open and inclusive culture

Weekly lunch stipend and snacks

Full health and dental benefits

Remote-flexible work environment

6 weeks of vacation

Job summary

A leading AI research company in Montreal is seeking a Senior ML Systems Engineer to develop and maintain the training framework for large-scale language models. This role involves designing distributed training systems and collaborating with teams to enhance performance. The ideal candidate will have strong experience in distributed training and HPC systems, with an emphasis on performance engineering. The role offers opportunities to work on cutting-edge technologies in a diverse and inclusive environment.

Qualifications

• Strong engineering experience in large-scale distributed training or HPC systems.
• Deep familiarity with distributed training libraries.
• Experience with containerized environments.

Responsibilities

• Build and own the training framework for large-scale LLM training.
• Collaborate closely with infra teams for high-performance training.
• Investigate and resolve performance bottlenecks across the ML systems.

Skills

Large-scale distributed training

HPC systems

Debugging performance issues

Collaboration skills

Tools

Docker

Slurm

Kubernetes

JAX

Job description

A leading AI research company in Montreal is seeking a Senior ML Systems Engineer to develop and maintain the training framework for large-scale language models. This role involves designing distributed training systems and collaborating with teams to enhance performance. The ideal candidate will have strong experience in distributed training and HPC systems, with an emphasis on performance engineering. The role offers opportunities to work on cutting-edge technologies in a diverse and inclusive environment.