Remote Staff AI Engineer — Post-Training to Production

Cohere; United States; Remote; USD 175,000 - 380,000; Full time

Benefits offered by this job

Weekly lunch stipend

Health and dental benefits

RRSP matching / 401K / Pension scheme

Parental leave top-up

Enrichment benefits for arts, fitness,

6 weeks of paid vacation

Travel budget to other offices

Job summary

Cohere is a leading security-first enterprise AI company building cutting-edge foundation models and end-to-end products designed to solve real-world business problems. We train and deploy frontier models for enterprises, valuing hands-on contributors who bridge research and production.

This remote-friendly role lets you work from anywhere or from our offices in Toronto, London, New York, San Francisco, Montreal, Paris, Berlin and Seoul.

Qualifications

• Extremely strong software engineering skills.
• Proficiency in Python and ML frameworks (JAX, PyTorch, XLA/MLIR).
• Experience with distributed training infrastructures (Kubernetes, Slurm) and Ray.
• Experience with large-scale distributed training strategies.
• Hands-on experience training large models at scale.
• Hands-on experience with the post-training phase, with emphasis on performance optimization.
• Bonus: publications at top-tier venues (e.g., NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, EMNLP).

Responsibilities

• Design and write high-performant and scalable software for training models.
• Consistently post-train the models to reach SOTA level performance.
• Coordinate with other specialist teams to produce models with strong all-encompassing performance.
• Craft and implement techniques to improve performance of training cycles (SFT and RL).
• Research, implement, and experiment with ideas on supercompute and data infrastructure.
• Learn from and work with the best researchers in the field.

Skills

Python

JAX

PyTorch

XLA/MLIR

Kubernetes

Slurm

Ray

Distributed training

Post-training optimization

Publications

Job description

Cohere is a leading security-first enterprise AI company building cutting-edge foundation models and end-to-end products designed to solve real-world business problems. We train and deploy frontier models for enterprises, valuing hands-on contributors who bridge research and production.

This remote-friendly role lets you work from anywhere or from our offices in Toronto, London, New York, San Francisco, Montreal, Paris, Berlin and Seoul.