Engineering Manager, GPU Infrastructure - Remote

Cohere; San Francisco (CA); Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Lunch stipend

Health/dental benefits

RRSP matching

Parental leave top‑up

Enrichment benefits

Education stipend

Vacation 6 weeks

Office travel budget

Home office stipend

Job summary

Cohere is seeking an Engineering Manager to lead a GPU infrastructure team powering frontier AI workloads. You will mentor engineers, shape strategy, and partner with AI researchers to deliver scalable, secure systems.

Join a remote‑friendly, high‑impact environment where you’ll drive performance, reliability, and cost optimization across multi‑cloud deployments while advancing Cohere’s mission to enable enterprise AI at scale.

Qualifications

• Experience leading engineering or SRE teams with technical mentorship.
• Strong knowledge of GPU/TPU clusters and distributed training frameworks.

Responsibilities

• Define and execute the technical roadmap for GPU cluster deployment, optimization, and scaling.
• Oversee workload scheduling, fault detection, and performance optimization systems.
• Collaborate with cloud providers and ML engineers to adapt training/inference stacks.
• Ensure infrastructure reliability, security, and cost control across environments.

Skills

GPU infrastructure

Kubernetes at scale

Prometheus/Grafana

Terraform/ArgoCD

Cost optimization

Collaboration with researchers

Leadership

Education

Master's or PhD in CS/CS-related

Tools

Multi-cloud technologies

Job description

Cohere is seeking an Engineering Manager to lead a GPU infrastructure team powering frontier AI workloads. You will mentor engineers, shape strategy, and partner with AI researchers to deliver scalable, secure systems.

Join a remote‑friendly, high‑impact environment where you’ll drive performance, reliability, and cost optimization across multi‑cloud deployments while advancing Cohere’s mission to enable enterprise AI at scale.