Lead AI Infrastructure Engineer - Distributed Systems

Cohere; Oregon; Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Health benefits

Parental leave

6 weeks paid vacation

Home office stipend

Job summary

Cohere is hiring for a role that builds and scales secure ML infrastructure for autonomous agents. You will own core platform capabilities, from execution to state management, and collaborate with ML researchers to translate ideas into reliable production systems.

The role requires strong systems fundamentals, expertise in agentic workflows, and experience with Kubernetes and model routing across diverse environments.

Qualifications

• Experience building production ML infrastructure with strong systems fundamentals.
• Hands-on work with agentic systems, multi-agent workflows, or agent development frameworks.
• Familiarity with model routing and LLM provider frameworks across different model types and environments.
• Experience with scalable, fault-tolerant distributed systems and Kubernetes.
• Ability to move quickly on prototypes and make production-ready decisions.

Responsibilities

• Turn emerging ML research ideas into production-ready infrastructure.
• Build core platform capabilities for execution, storage, and state management.
• Prototype and evaluate new technologies, then decide what should move into production.
• Partner with research teams to shape infrastructure for future agent systems.

Skills

ML infra

Agentic systems

Distributed systems

Kubernetes

Model routing

Tools

Kubernetes

Job description

Cohere is hiring for a role that builds and scales secure ML infrastructure for autonomous agents. You will own core platform capabilities, from execution to state management, and collaborate with ML researchers to translate ideas into reliable production systems.

The role requires strong systems fundamentals, expertise in agentic workflows, and experience with Kubernetes and model routing across diverse environments.