Principal AI Infra Engineer – Agentic Platforms

Jaide Health; United States; Remote; USD 140,000 - 220,000; Full time

Benefits offered by this job

Weekly lunch stipend $75/£75 or local?

Full health and dental benefits

RRSP/401K and pension

Parental leave top-up

Annual enrichment benefits and stipens

6 weeks paid vacation

Home office stipend $500

Job summary

Cohere is building the next generation of agentic AI infrastructure, combining ML systems, distributed infrastructure, and developer experience. You will help create a platform that powers autonomous AI agents at scale, tackling secure code execution, state management, model routing, and resource control.

This role suits someone with deep systems knowledge and ML intuition, comfortable delivering reliable infrastructure and evaluating new tech for production.

Qualifications

• Experience building production ML infrastructure with strong systems fundamentals.
• Hands-on work with agentic systems, multi-agent workflows, or agent development frameworks.
• Familiarity with model routing and LLM provider frameworks across different model types and environments.
• Experience with scalable, fault-tolerant distributed systems and Kubernetes.
• A track record of moving quickly on prototypes and making good decisions about productionization.

Responsibilities

• Turn emerging ML research ideas into production-ready infrastructure.
• Build core platform capabilities for execution, storage, and state management.
• Prototype and evaluate new technologies, then help decide what should move into production.
• Partner with research teams to shape infrastructure based on what future agent systems will need.

Skills

Strong systems fundamentals

Agentic systems experience

Model routing familiarity

Kubernetes

Production ML infrastructure

Tools

Kubernetes

Distributed systems

Job description

Cohere is building the next generation of agentic AI infrastructure, combining ML systems, distributed infrastructure, and developer experience. You will help create a platform that powers autonomous AI agents at scale, tackling secure code execution, state management, model routing, and resource control.

This role suits someone with deep systems knowledge and ML intuition, comfortable delivering reliable infrastructure and evaluating new tech for production.