Member of Technical Staff, Post-Training

Cohere; Deutschland; Vor Ort; EUR 70.000 - 90.000; Vollzeit

Zusammenfassung

Cohere is looking for a skilled engineer to advance the state of the art in model post-training and ship state-of-the-art models to production. You will design and write high-performance software and coordinate with specialist teams to produce models with excellent performance.

The ideal candidate has strong software engineering skills, proficiency in Python, and experience with distributed training infrastructures. If interested, we encourage you to reach out even if you don't meet all criteria.

Qualifikationen

• Extremely strong software engineering skills required.
• Proficiency in Python and related ML frameworks like JAX and PyTorch essential.
• Hands-on experience with the post-training phase of model training needed.

Aufgaben

• Design and write scalable software for training models.
• Coordinate with specialist teams to produce high-performance models.
• Research and implement ideas on super-compute and data infrastructure.

Kenntnisse

Strong software engineering skills

Proficiency in Python and ML frameworks

Experience with distributed training infrastructures

Hands-on experience training large models

Experience with post-training optimisation

Tools

Kubernetes

Slurm

Ray

Jobbeschreibung

Why this role?

Advance the state of the art for model post‑training, ship state‑of‑the‑art models to production, and bridge the gap between research and production. We have one of the highest compute‑to‑engineer ratios in the world, and we do not delineate strongly between engineering and research. Everyone writes production code and supports our research effort depending on interest and organisational needs. With all the compute, data, and talent available, you will be empowered to do your best work.

Please note: We have offices in London, Paris, Toronto, San Francisco, and New York, and we also embrace being remote‑friendly.

Responsibilities

• Design and write high‑performant, scalable software for training models.
• Consistently post‑train the models to reach SOTA level performance.
• Coordinate with other specialist teams (Agentic, Code…) to produce models that have strong, all‑encompassing performance.
• Craft and implement techniques to improve the performance and results of our training cycles both on the SFT and the RL regime.
• Research, implement, and experiment with ideas on our super‑compute and data infrastructure.
• Learn from and work with the best researchers in the field.

Skills & Experience

• Extremely strong software engineering skills.
• Proficiency in Python and related ML frameworks such as JAX, PyTorch, and XLA/MLIR.
• Experience with distributed training infrastructures (Kubernetes, Slurm) and associated frameworks (Ray).
• Experience using large‑scale distributed training strategies.
• Hands‑on experience training large models at scale.
• Hands‑on experience with the post‑training phase of model training, with a strong emphasis on performance optimisation.
• Bonus: papers at top‑tier venues (such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, EMNLP).

These are neither an exhaustive nor a necessary set of attributes. Even if none of these apply to you, but you believe you will contribute to Cohere, please reach out.