Senior Staff ML Infrastructure Engineer - Agent Systems

Cohere; United States; Remote; USD 140,000 - 210,000; Full time

Job summary

Cohere is building the next generation of agentic AI infrastructure. You’ll work at the intersection of ML systems and distributed infrastructure, developing secure execution environments, state management, and resource orchestration for agent workflows.

You will transform research ideas into reliable, production-ready platform capabilities and partner with research teams to shape infrastructure for future agent systems across on-prem and cloud environments.

Qualifications

• Experience building production ML infrastructure with strong systems fundamentals.
• Hands-on work with agentic systems, multi-agent workflows, or agent development frameworks.
• Familiarity with model routing and LLM provider frameworks across different model types and environments.
• Experience with scalable, fault-tolerant distributed systems and Kubernetes.

Responsibilities

• Turn emerging ML research ideas into production-ready infrastructure.
• Build core platform capabilities for execution, storage, and state management.
• Prototype and evaluate new technologies, then help decide what should move into production.
• Partner with research teams to shape infrastructure based on what future agent systems will need.

Skills

ML Infra

Distributed Systems

Multi-Agent Workflows

Agent Frameworks

Model Routing

Systems Fundamentals

LLM Integration

Tools

Kubernetes

Job description

Cohere is building the next generation of agentic AI infrastructure. You’ll work at the intersection of ML systems and distributed infrastructure, developing secure execution environments, state management, and resource orchestration for agent workflows.

You will transform research ideas into reliable, production-ready platform capabilities and partner with research teams to shape infrastructure for future agent systems across on-prem and cloud environments.