Senior ML Infrastructure Engineer - Agent Platform

Cohere; San Francisco (CA); Hybrid; USD 240,000 - 360,000; Full time

Benefits offered by this job

Lunch stipend and health benefits

Parental leave and enrichment benefits

Paid vacation and travel budget

Home office stipend

401K/retirement benefits

Office presence across multiple cities

Job summary

Cohere in San Francisco is building the next generation of agentic AI infrastructure. You will turn ML research into production-ready systems, handling execution, storage, and state management for secure, scalable multi-model workflows.

You’ll prototype and evaluate new technologies, collaborate with research teams, and help decide what moves into production while navigating distributed systems tradeoffs and model routing.

Qualifications

• Experience building production ML infrastructure with strong systems fundamentals.
• Hands-on work with agentic systems, multi-agent workflows, or agent development frameworks.
• Familiarity with model routing and LLM provider frameworks across different model types and environments.

Responsibilities

• Turn emerging ML research ideas into production-ready infrastructure.
• Build core platform capabilities for execution, storage, and state management.
• Prototype and evaluate new technologies, then help decide what should move into production.
• Partner with research teams to shape infrastructure based on what future agent systems will need.

Skills

ML infrastructure

Agentic systems

Multi-agent workflows

Model routing

Distributed systems

Kubernetes

Tools

LLM/provider frameworks

Job description

Cohere in San Francisco is building the next generation of agentic AI infrastructure. You will turn ML research into production-ready systems, handling execution, storage, and state management for secure, scalable multi-model workflows.

You’ll prototype and evaluate new technologies, collaborate with research teams, and help decide what moves into production while navigating distributed systems tradeoffs and model routing.