Engineering Manager, GPU Infrastructure & Platforms

cohere; United States; Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Lunch stipend

Health & dental benefits

RRSP/401K matching

Parental leave

Education stipend

6 weeks vacation

Remote/office flexibility

Home office stipend

Job summary

Cohere is seeking an Engineering Manager to lead a team focused on GPU infrastructure and scalable AI deployment. You will shape the technical roadmap, mentor engineers, and partner with researchers and cloud providers in a remote-first environment.

You should have a track record building HPC/ML infrastructure, Kubernetes at scale, and strong leadership. This role offers meaningful impact on frontier AI with a collaborative culture and flexible work options.

Qualifications

• Experience leading engineering or SRE teams with mentorship and growth.
• Strong communication skills to translate complex concepts.
• Ability to make data-informed decisions under pressure.

Responsibilities

• Lead and mentor a team of engineers specializing in GPU infrastructure and scalable AI workloads.
• Define and execute the technical roadmap for GPU cluster deployment and optimization.
• Oversee workload scheduling, hardware fault detection, and performance optimization systems.
• Collaborate with cloud providers and researchers to adapt training/inference stacks and ensure reliability and security.

Skills

Engineering Leadership

Remote collaboration

Data-driven decisions

Team mentorship

Education

Experience managing engineering/SRE teams

Tools

Kubernetes

Prometheus

Grafana

Terraform

ArgoCD

Job description

Cohere is seeking an Engineering Manager to lead a team focused on GPU infrastructure and scalable AI deployment. You will shape the technical roadmap, mentor engineers, and partner with researchers and cloud providers in a remote-first environment.

You should have a track record building HPC/ML infrastructure, Kubernetes at scale, and strong leadership. This role offers meaningful impact on frontier AI with a collaborative culture and flexible work options.