Member of Technical Staff, Training Performance Engineer

Cohere; Greater London; On-site; GBP 70,000 - 90,000; Full time

Job summary

Deepstreamtech is seeking a Performance Engineer in Greater London to enhance the performance of their advanced language models. The role demands strong software engineering and machine learning expertise, focusing on optimizing training metrics and developing efficient systems. You will work on CUDA and other tools to drive innovation in natural language processing and collaborate with leading researchers in the field.

Qualifications

• Extremely strong software engineering skills.
• Proficiency in Python and related ML frameworks such as JAX, Pytorch.
• Experience writing kernels for GPUs using CUDA, triton.

Responsibilities

• Optimize performance of advanced language models and systems.
• Improve key model training metrics like training throughput.
• Design high-performant software for training.

Skills

Software engineering skills

Proficiency in Python

Experience with ML frameworks (JAX, Pytorch)

Experience with GPU programming

Experience with distributed training

Familiarity with Transformers

Research paper publication

Job description

Requirements

• Extremely strong software engineering skills
• Proficiency in Python and related ML frameworks such as JAX, Pytorch and XLA/MLIR
• Experience writing kernels for GPUs using CUDA, triton, etc
• Experience using large-scale distributed training strategies
• Familiarity with autoregressive sequence models, such as Transformers
• (Desirable) Bonus: paper at top-tier venues (such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, EMNLP)
• If some of the above doesn’t line up perfectly with your experience, we still encourage you to apply!

What the job involves

• As a Performance Engineer in the Pre-Training team you will be responsible for optimizing the performance of our advanced language models and systems
• Their primary focus is on improving key model training metrics, such as training throughput, ensuring high accelerator utilization
• The team combines expertise in software engineering, machine learning, and low-level kernel design and development to design robust systems and enhance model performance
• You will work on identifying and removing performance bottlenecks, develop cutting‑edge training and profiling tools to help Cohere's mission of providing efficient and reliable language understanding and generation capabilities and drive innovation in the field of natural language processing
• Design and write high-performant and scalable software for training
• Understand architectural modifications and design choices and their effects on training throughput and quality
• Write low-level CUDA, triton kernels to squeeze every last bit of performance from our accelerators
• Research, implement, and experiment with ideas on our supercompute and data infrastructure
• Learn from and work with the best researchers in the field