GPU Infrastructure Engineering Lead

Neura Market; United States; On-site; CAD 140,000 - 210,000; Full time

Benefits offered by this job

Lunch stipend

Health and dental benefits

RRSP matching / Pension

Parental leave top-up

Enrichment benefits (education &学习

Vacation (6 weeks)

Travel budget to other offices

Home office stipend

Job summary

Cohere is hiring an Engineering Manager to lead a team of engineers focused on building and operating GPU infrastructure for frontier AI models. You will define roadmaps, guide workload scheduling, and ensure reliability across multi-cloud environments.

The role emphasizes collaboration with AI researchers and capacity planning, with a remote-friendly culture and strong emphasis on technical excellence and impact.

Qualifications

• Experience leading engineering or SRE teams with a focus on mentorship and growth.
• Ability to translate complex concepts for diverse audiences.
• Proven track record in remote, distributed teams.

Responsibilities

• Lead and mentor a team of engineers focused on GPU infrastructure.
• Define the technical roadmap for GPU cluster deployment, optimization, and scaling.
• Oversee workload scheduling, fault detection, and performance improvements.
• Collaborate with cloud providers and ML engineers on adapting the training/inference stack.

Skills

GPU infrastructure

Leadership

Kubernetes at scale

Prometheus/Grafana

Terraform/ArgoCD

Cost optimization

Collaboration with researchers

Tools

JAX/PyTorch/TensorFlow

Job description

Cohere is hiring an Engineering Manager to lead a team of engineers focused on building and operating GPU infrastructure for frontier AI models. You will define roadmaps, guide workload scheduling, and ensure reliability across multi-cloud environments.

The role emphasizes collaboration with AI researchers and capacity planning, with a remote-friendly culture and strong emphasis on technical excellence and impact.