AI Infrastructure Architect for Agentic Systems

Cohere; United States; Hybrid; USD 150,000 - 230,000; Full time

Benefits offered by this job

Lunch stipend

Health benefits

401(k) plan

Parental leave top-up

Education & learning stipend

Vacation days

Job summary

Cohere in the United States is building the next generation of agentic AI infrastructure. This team sits at the intersection of ML systems, distributed infrastructure, and developer experience, creating the platform that powers autonomous AI agents at scale.

You’ll work on hard problems like secure code execution, identity and authentication, model routing, and resource management for long-running agent workflows.

Qualifications

• Experience building production ML infrastructure with strong systems fundamentals.
• Hands-on work with agentic systems and multi-agent workflows.
• Familiarity with model routing and LLM provider frameworks.

Responsibilities

• Turn emerging ML research ideas into production-ready infrastructure.
• Build core platform capabilities for execution, storage, and state management.
• Prototype and evaluate new technologies, then decide what moves to production.
• Collaborate with research teams to shape infrastructure for future agent systems.

Skills

Production ML infrastructure

Agentic systems

Multi-agent workflows

Model routing & LLM frameworks

Distributed systems & Kubernetes

Tools

Kubernetes

Job description

Cohere in the United States is building the next generation of agentic AI infrastructure. This team sits at the intersection of ML systems, distributed infrastructure, and developer experience, creating the platform that powers autonomous AI agents at scale.

You’ll work on hard problems like secure code execution, identity and authentication, model routing, and resource management for long-running agent workflows.