Staff Engineer, Training Infrastructure & ML Pipelines

Cohere; United States; Remote; USD 180,000 - 260,000; Full time

Benefits offered by this job

Lunch stipend

Health & dental benefits

401K / Pension

Parental leave top‑up

Enrichment benefits

Job summary

Cohere is seeking a Member of Technical Staff to advance training pipelines and ship state‑of‑the‑art models. You will help bridge research and production by writing scalable training software and improving infrastructure. You will collaborate with researchers and engineers to push the frontier of enterprise AI.

The role offers remote-friendly placement with access to extensive compute and data resources, and opportunities to publish and contribute to tooling for large-scale model training.

Qualifications

• Extremely strong software engineering skills.
• Proficiency in Python and ML frameworks such as JAX, Pytorch and XLA/MLIR.
• Experience with distributed training infrastructures (Kubernetes, Slurm) and frameworks (Ray).
• Experience using large-scale distributed training strategies.
• Hands on experience on training large model at scale and having contributed to the tooling and/or setup of the training infrastructure.
• Bonus: paper at top-tier venues (such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, EMNLP).

Responsibilities

• Design and write high-performant and scalable software for training.
• Improve our training setup from an infrastructure and codebase performance standpoint.
• Craft and implement tools to speed up our training cycles and improve the overall efficacy of our training infrastructure.
• Research, implement, and experiment with ideas on our supercompute and data infrastructure.
• Learn from and work with the best researchers in the field.

Skills

Software engineering

Python

ML frameworks (JAX, PyTorch, XLA/MLIR)

Distributed training infra (Kubernetes

Slurm

Ray

Large-scale distributed training

Training tooling/infra

Research papers (top-tier)

Tools

Kubernetes

Slurm

Ray

JAX

PyTorch

XLA/MLIR

Job description

Cohere is seeking a Member of Technical Staff to advance training pipelines and ship state‑of‑the‑art models. You will help bridge research and production by writing scalable training software and improving infrastructure. You will collaborate with researchers and engineers to push the frontier of enterprise AI.

The role offers remote-friendly placement with access to extensive compute and data resources, and opportunities to publish and contribute to tooling for large-scale model training.