Senior Production AI Systems Engineer

Jaide Health; Toronto; Hybrid; CAD 140,000 - 210,000; Full time

Benefits offered by this job

Lunch stipend

Health and dental benefits

RRSP matching

Parental leave top-up

Enrichment benefits stipend

6 weeks vacation

Travel budget to other offices

Home office stipend

Job summary

Cohere in Canada is seeking a Senior Staff Software Engineer to design and build production-ready systems that power large-scale AI models. You will drive tooling for ML research and collaborate across Infra, Efficiency, Serving, and science teams to push frontier models into production.

You will optimize ML code, experiment with frontier models on our cluster, and help shape architectures that scale. The role blends research with engineering in a fast-paced, inclusive environment.

Qualifications

• Extremely strong software engineering skills.
• Value test-driven development methods, clean code, and strive to reduce technical debts at all levels.
• Proficiency in Python and related ML frameworks such as JAX, Pytorch and/or XLA/MLIR.
• Experience using and debugging large-scale distributed training strategies (memory/speed profiling).
• Experience with distributed training infrastructures (Kubernetes) and associated frameworks (Ray).
• Experience in ML and LLM academic research.

Responsibilities

• Design and write high‑performing and scalable software for training models.
• Develop new tools to support and accelerate research and LLM training.
• Coordinate with other engineering teams (Infrastructure, Efficiency, Serving) and the scientific teams (Agent, Multimodal, Multilingual, etc.).
• Research, implement, and experiment with ideas on our cluster and data infrastructure.
• Collaborate, Collaborate, and Collaborate with other scientists, engineers, and teams!

Skills

Software engineering

Test-driven development

Python

ML frameworks (JAX)

PyTorch

Distributed training

Ray

ML/LLM research

Tools

Kubernetes

Ray

JAX

PyTorch

XLA/MLIR

Job description

Cohere in Canada is seeking a Senior Staff Software Engineer to design and build production-ready systems that power large-scale AI models. You will drive tooling for ML research and collaborate across Infra, Efficiency, Serving, and science teams to push frontier models into production.

You will optimize ML code, experiment with frontier models on our cluster, and help shape architectures that scale. The role blends research with engineering in a fast-paced, inclusive environment.