Senior Staff Engineer - Production AI & LLM (Remote)

Cohere; España; Hybrid; EUR 90,000 - 130,000; Full time

Benefits offered by this job

Lunch stipend

Health benefits

Parental leave

Enrichment benefits

Learning stipend

Vacation days

Office travel budget

Home office stipend

Job summary

Cohere, a leading security-first enterprise AI company, seeks a senior engineer to join our Technical Staff. You will design production-grade software for training foundation models, develop new tooling, and collaborate across infra, research and product teams to advance scalable AI systems.

This hands-on, engineering-driven role emphasizes excellence in both engineering and science, with access to world-class compute resources and data to enable impactful work.

Qualifications

• Extremely strong software engineering skills.
• Proficiency in Python and ML frameworks (JAX, PyTorch, XLA/MLIR).
• Experience with distributed training (memory/speed profiling).
• Experience with Kubernetes and Ray frameworks.
• ML and LLM academic research experience.

Responsibilities

• Design and write high-performing, scalable software for training models.
• Develop tools to support research and LLM training.
• Coordinate with Infrastructure, Efficiency, Serving and science teams.
• Research and experiment with ideas on cluster and data infrastructure.
• Collaborate with scientists, engineers and teams.

Skills

Python

JAX

PyTorch

XLA/MLIR

Distributed training

Kubernetes

Ray

LLM research

Tools

Terraform

Job description

Cohere, a leading security-first enterprise AI company, seeks a senior engineer to join our Technical Staff. You will design production-grade software for training foundation models, develop new tooling, and collaborate across infra, research and product teams to advance scalable AI systems.

This hands-on, engineering-driven role emphasizes excellence in both engineering and science, with access to world-class compute resources and data to enable impactful work.