Remote GPU Infra Engineer - Kubernetes & Multi-Cloud

The Briefed; United States; Remote; USD 175,000 - 325,000; Full time

Benefits offered by this job

Lunch stipend

Health insurance

Dental cover

401(k)

Paid vacation

Learning stipend

Job summary

Cohere is hiring for an Internal Infrastructure role focused on running and expanding GPU Kubernetes fleets across clouds. You will work with researchers and ML engineers, diagnose Linux and networking issues, and write Python or Go code to automate tasks and improvements.

The role supports remote-friendly work in the United States, with a 24x7 on-call rotation and opportunities to optimize hardware, performance, and cost. Competitive salary and equity are offered along with health benefits.

Qualifications

• Ran GPU Kubernetes clusters with thousands of GPUs for ML or HPC workloads.
• Debugged Linux, networking and performance problems.
• Wrote software in Python or Go.
• Collaborated with researchers or ML engineers with different goals.

Responsibilities

• Deploy and run GPU Kubernetes clusters across clouds and bring up new hardware.
• Work with cloud providers and hardware partners on reliability, performance and cost, including RDMA.
• Automate fault detection and repair for nodes, GPUs and network fabric.
• Improve fleet use, track cost and shorten the time to return a faulty node.
• Join the paid 24x7 on-call rotation.

Skills

GPU Kubernetes

Linux debugging

Python

Go

Networking

Cloud platforms

Tools

RDMA

NCCL

Job description

Cohere is hiring for an Internal Infrastructure role focused on running and expanding GPU Kubernetes fleets across clouds. You will work with researchers and ML engineers, diagnose Linux and networking issues, and write Python or Go code to automate tasks and improvements.

The role supports remote-friendly work in the United States, with a 24x7 on-call rotation and opportunities to optimize hardware, performance, and cost. Competitive salary and equity are offered along with health benefits.