Senior AI Infrastructure Engineer – Agent Systems

cohere; Toronto (OH); Hybrid; USD 120,000 - 150,000; Full time

Benefits offered by this job

Weekly lunch stipend

Full health and dental benefits

RRSP matching, 401(k), pension scheme

100% parental leave top-up

6 weeks of paid vacation

Remote-friendly work options

Job summary

Cohere is looking for a dedicated individual to help build next-generation agentic AI infrastructure. You will work on production-ready systems with a focus on secure execution, identity management, and resource orchestration. The ideal candidate has a strong background in ML infrastructure and distributed systems, and you will collaborate closely with research teams to develop innovative solutions.

Join a passionate team at Cohere and contribute to the future of AI in a supportive environment with an array of employee benefits.

Qualifications

• Experience building production ML infrastructure.
• Hands-on work with agentic systems and multi-agent workflows.
• Familiarity with model routing and LLM frameworks.

Responsibilities

• Turn emerging ML research into production-ready infrastructure.
• Build core platform capabilities for execution and state management.
• Prototype and evaluate new technologies.

Skills

Building production ML infrastructure

Experience with agentic systems

Strong systems fundamentals

Scalable distributed systems

Tools

Kubernetes

Code execution sandboxes

Job description

Cohere is looking for a dedicated individual to help build next-generation agentic AI infrastructure. You will work on production-ready systems with a focus on secure execution, identity management, and resource orchestration. The ideal candidate has a strong background in ML infrastructure and distributed systems, and you will collaborate closely with research teams to develop innovative solutions.

Join a passionate team at Cohere and contribute to the future of AI in a supportive environment with an array of employee benefits.