Senior GPU HPC Infrastructure Engineer for ML Pipelines

Jaide Health; United States; Hybrid; USD 180,000 - 250,000; Full time

Benefits offered by this job

Weekly lunch stipend

Health and dental benefits

Parental leave

Education & learning stipend

6 weeks vacation

Remote office stipend

Job summary

Cohere is seeking a Staff Software Engineer to design and operate ML/HPC infrastructure that powers front-line AI workloads. You will deploy and manage GPU/TPU clusters and scale distributed training across multiple clouds, ensuring reliability and performance for researchers.

You will collaborate closely with AI researchers, build self-service tooling, and promote observability, IaC, and automation to improve efficiency and resilience across the platform.

Qualifications

• Deep expertise in ML/HPC infrastructure: GPU/TPU clusters, distributed training frameworks (JAX, PyTorch, TensorFlow), and HPC environments.

Responsibilities

• Build and scale ML-optimized HPC infrastructure across multiple clouds, ensuring high throughput and low latency for AI workloads.

Skills

ML/HPC infra

Kubernetes at scale

Python

Go

Linux internals

RDMA/NCCL

Research collaboration

Self-directed problem solving

Tools

Kubernetes

RDMA

NCCL

PyTorch

JAX

TensorFlow

Go

Python

Linux

Job description

Cohere is seeking a Staff Software Engineer to design and operate ML/HPC infrastructure that powers front-line AI workloads. You will deploy and manage GPU/TPU clusters and scale distributed training across multiple clouds, ensuring reliability and performance for researchers.

You will collaborate closely with AI researchers, build self-service tooling, and promote observability, IaC, and automation to improve efficiency and resilience across the platform.