Remote GPU Infrastructure Engineer — Kubernetes & Cloud

Cohere

United States

Hybrid

USD 140,000 - 230,000

Full time

11 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

A weekly lunch stipend $75/£75 or équv
Full health and dental benefits
100% Parental Leave top-up for up to 6
Education & learning stipend for confs
6 weeks of paid vacation
Travel budget to other offices

Job summary

Cohere is seeking a talented Infrastructure Engineer to deploy and operate GPU Kubernetes clusters across multi-cloud environments, collaborating with AI researchers and ML engineers to improve stability and scalability. You will automate fault detection, optimize fleet performance, and drive cost-effective infrastructure for frontier models.

Ideal candidates will have hands-on experience with Kubernetes, RDMA/NCCL concepts, and Python or Go, plus a track record of working with researchers or ML

Qualifications

  • Experience running GPU Kubernetes clusters for ML/HPC workloads.
  • Ability to debug Linux, networking and performance issues.
  • Proficiency in Python or Go.
  • Collaborate with researchers and ML engineers on scale and reliability.
  • Experience driving fixes in fast-moving environments.

Responsibilities

  • Deploy and operate GPU Kubernetes clusters across clouds.
  • Collaborate with cloud providers and hardware partners on reliability, performance and cost.
  • Automate node, GPU and fabric fault detection and remediation.
  • Improve fleet utilization and reduce time to recovery for faulty nodes.
  • Troubleshoot production failures and performance bottlenecks.

Skills

GPU Kubernetes
Linux debugging
Python or Go
Research collaboration
Performance optimization

Tools

Kubernetes
RDMA
NCCL

Job description

Cohere is seeking a talented Infrastructure Engineer to deploy and operate GPU Kubernetes clusters across multi-cloud environments, collaborating with AI researchers and ML engineers to improve stability and scalability. You will automate fault detection, optimize fleet performance, and drive cost-effective infrastructure for frontier models.

Ideal candidates will have hands-on experience with Kubernetes, RDMA/NCCL concepts, and Python or Go, plus a track record of working with researchers or ML

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote GPU Kubernetes Infrastructure Engineer
Remote GPU Kubernetes Infrastructure Engineer

Cohere • United States

Remote
USD 140,000 - 210,000
Weekly lunch stipend
Health and dental benefits
RRSP matching
+5
Remote GPU Infra Engineer - Kubernetes & Multi-Cloud
Remote GPU Infra Engineer - Kubernetes & Multi-Cloud

The Briefed • United States

Remote
USD 175,000 - 325,000
Lunch stipend
Health insurance
Dental cover
+3
GPU Infrastructure Engineer – Kubernetes & Multi-Cloud
GPU Infrastructure Engineer – Kubernetes & Multi-Cloud

Cohere • Seattle (WA)

Hybrid
USD 180,000 - 260,000
Weekly lunch stipend: $75/£75 or local
Health and dental benefits
RRSP matching / Pension
+6
GPU Infrastructure Engineer — Remote & Multi-Cloud Clusters
GPU Infrastructure Engineer — Remote & Multi-Cloud Clusters

Cohere • New York (NY)

Hybrid
USD 140,000 - 210,000
Weekly lunch stipend
Full health and dental benefits
RRSP matching / 401K / Pension
+5
GPU Infrastructure Engineer — Remote & Multi-Cloud Clusters
GPU Infrastructure Engineer — Remote & Multi-Cloud Clusters

Cohere • California

Remote
USD 180,000 - 230,000
A weekly lunch stipend of $75/£75 or:"
Full health and dental benefits
RRSP matching, 401K, Pension Scheme
+6
Remote AI Infrastructure Engineer — Kubernetes & GPU
Remote AI Infrastructure Engineer — Kubernetes & GPU

Gomyneed Private Limited • San Francisco (CA)

Hybrid
USD 121,000 - 137,000
Equity
Bonus
Software Engineer, GPU Infrastructure & Kubernetes (Remote) NEW
Software Engineer, GPU Infrastructure & Kubernetes (Remote) NEW

The Briefed • United States

Remote
USD 175,000 - 325,000
Lunch stipend
Health insurance
Dental cover
+3
Remote GPU Kubernetes Platform Engineer
Remote GPU Kubernetes Platform Engineer

Qubrid • McLean (VA)

Hybrid
USD 140,000 - 200,000
Cloud Infrastructure Engineer — GPU AI Kubernetes
Cloud Infrastructure Engineer — GPU AI Kubernetes

FriendliAI Inc. • San Francisco (CA)

On-site
USD 210,000 - 270,000
Flexible hours
Meals provided daily
Collaborative culture
+2
Kubernetes Runtime & Release Engineer - GPU Cloud (Equity)
Kubernetes Runtime & Release Engineer - GPU Cloud (Equity)

NVIDIA Corporation • Santa Clara (CA)

On-site
CAD 263,000 - 510,000
Equity
Benefits