Staff Engineer - AI Systems & Post-Training RL

Cohere; New York (NY); On-site; USD 150,000 - 230,000; Full time

Benefits offered by this job

Lunch stipend and health benefits

Dental benefits

RRSP/401K/Pension

Parental leave

Education stipend

Vacation 6 weeks

Travel/Offsite budget

Home office stipend

Co-working option

Job summary

Cohere, a leading security-first enterprise AI company, is hiring for a Member of Technical Staff to design scalable training software and tools for LLM post-training. You will collaborate across Infrastructure, Efficiency, Serving, and scientific teams to push the boundaries of model performance.

The role emphasizes research, experimentation, and production-level code, with remote-friendly options and offices around the world.

Qualifications

• Extremely strong software engineering skills.
• Value test-driven development methods, clean code, and strive to reduce technical debts at all levels.
• Proficiency in Python and related ML frameworks such as JAX, Pytorch and/or XLA/MLIR.
• Experience using and debugging large-scale distributed training strategies (memory/speed profiling).
• [Bonus] Experience with distributed training infrastructures (Kubernetes) and associated frameworks (Ray).
• [Bonus] Hands-on experience with the post-training phase of model training, with a strong emphasis on scalability and performance.
• [Bonus] Experience in ML, LLM and RL academic research.

Responsibilities

• Design and write high-performing and scalable software for training models.
• Develop new tools to support and accelerate research and LLM training.
• Coordinate with other engineering teams (Infrastructure, Efficiency, Serving) and the scientific teams to create a strong and integrated post-training ecosystem.
• Craft and implement techniques to improve performance and speed up training cycles.
• Research, implement, and experiment with ideas on our cluster and data infrastructure.
• Collaborate with other scientists, engineers, and teams!

Skills

Python

JAX/PyTorch

Distributed training

Kubernetes

Ray

Clean code

Test-driven development

Tools

Kubernetes

Ray

Job description

Cohere, a leading security-first enterprise AI company, is hiring for a Member of Technical Staff to design scalable training software and tools for LLM post-training. You will collaborate across Infrastructure, Efficiency, Serving, and scientific teams to push the boundaries of model performance.

The role emphasizes research, experimentation, and production-level code, with remote-friendly options and offices around the world.