Remote Performance Engineer: ML Training & Kernels

Cohere; Greater London; On-site; GBP 75,000 - 95,000; Full time

Benefits offered by this job

Co-working benefit

Daily lunch program

Regular community and social events

Job summary

Cohere is seeking a Performance Engineer in Greater London to optimize the performance of advanced language models and systems. You will focus on improving model training metrics and ensuring high accelerator utilization.

The role involves designing scalable software, writing low-level CUDA kernels, and experimenting with ideas on super-compute infrastructure. Applicants should have strong software engineering skills and proficiency in Python, with experience in GPUs and distributed training.

Cohere supports a remote-friendly work environment, offering benefits like co-working spaces for remote teams.

Qualifications

• Extremely strong software engineering skills.
• Proficiency in Python and related ML frameworks.
• Experience writing kernels for GPUs using CUDA.

Responsibilities

• Design and write high‑performant and scalable software for training.
• Understand architectural modifications and their effects on training throughput.
• Research and implement ideas on our super‑compute and data infrastructure.

Skills

Strong software engineering skills

Proficiency in Python

Experience with ML frameworks such as JAX

Experience writing kernels for GPUs using CUDA

Familiarity with autoregressive sequence models

Job description

Cohere is seeking a Performance Engineer in Greater London to optimize the performance of advanced language models and systems. You will focus on improving model training metrics and ensuring high accelerator utilization.

The role involves designing scalable software, writing low-level CUDA kernels, and experimenting with ideas on super-compute infrastructure. Applicants should have strong software engineering skills and proficiency in Python, with experience in GPUs and distributed training.

Cohere supports a remote-friendly work environment, offering benefits like co-working spaces for remote teams.