GPU Platform Engineer — Kubernetes & AI Workloads

Waratah Recruitment Partners

United States

Remote

USD 150,000 - 230,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Waratah Recruitment Partners seeks an experienced Platform Engineer/SRE to build and operate a multi-tenant GPU-as-a-Service platform for AI workloads. You will leverage Kubernetes and Slurm to orchestrate GPU resources at scale.

This role requires 4–8+ years in platform engineering, strong cloud-native skills, IaC with Terraform and Ansible, and a proven ability to drive reliability, security, and cost efficiency across teams.

Qualifications

  • 4–8+ years in platform engineering or SRE.
  • Deep experience with Kubernetes and cloud-native infrastructure at scale.
  • Background in GPU workloads, distributed systems, CI/CD and automation.
  • Strong communication and stakeholder management skills.

Responsibilities

  • Build and run a multi-tenant GPU-as-a-Service platform for AI workloads.
  • Develop GPU orchestration and scheduling using Kubernetes and Slurm.
  • Manage GPU-enabled Kubernetes clusters with advanced workload scheduling.
  • Write Infrastructure-as-Code with Terraform and Ansible.
  • Deliver self-service APIs, CLI tools and portals for GPU provisioning.
  • Create CI/CD pipelines for platform services, backed by monitoring and observability.
  • Work with teams across AI training and inference to optimize performance.
  • Improve GPU utilisation, performance and cost efficiency.
  • Own reliability, security and tenant isolation, including incident response.

Skills

Kubernetes orchestration
Cloud-native infrastructure
GPU workloads
CI/CD automation
Terraform & Ansible

Education

Bachelor's degree in Computer Science or equivalent

Tools

Terraform
Ansible
Kubernetes
Slurm
CUDA/NCCL knowledge
PyTorch/TensorFlow familiarity
Kubeflow/Airflow familiarity

Job description

Waratah Recruitment Partners seeks an experienced Platform Engineer/SRE to build and operate a multi-tenant GPU-as-a-Service platform for AI workloads. You will leverage Kubernetes and Slurm to orchestrate GPU resources at scale.

This role requires 4–8+ years in platform engineering, strong cloud-native skills, IaC with Terraform and Ansible, and a proven ability to drive reliability, security, and cost efficiency across teams.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Platform Engineer
Platform Engineer

Waratah Recruitment Partners • United States

Remote
USD 150,000 - 230,000
Backend Platform Engineer – GPU Cluster Automation
Backend Platform Engineer – GPU Cluster Automation

TensorWave • Las Vegas (NV)

On-site
USD 140,000 - 210,000
Stock Options
Excellent health insurance
401(k)
+6
Senior GPU Cloud Platform Engineer (Remote)
Senior GPU Cloud Platform Engineer (Remote)

STN Incorporated • United States

Hybrid
USD 140,000 - 180,000
AI Infrastructure Architect | Kubernetes & GPU Ops
AI Infrastructure Architect | Kubernetes & GPU Ops

HCL Technologies Limited • United States

On-site
USD 140,000 - 170,000
Staff Platform Engineer - Multi-Cloud GPU & Kubernetes
Staff Platform Engineer - Multi-Cloud GPU & Kubernetes

Reflection AI Ltd • New York (NY)

On-site
USD 180,000 - 240,000
Top-tier compensation
Stock options
Health & wellness
+5
Staff Kubernetes Engineer: AI GPU Orchestration Bare-Metal
Staff Kubernetes Engineer: AI GPU Orchestration Bare-Metal

Cloudjobs • San Jose (CA)

On-site
USD 230,000 - 360,000
Cash compensation
Equity compensation
Health coverage
+6
Platform Engineer (GPU)
Platform Engineer (GPU)

Vero • United States

On-site
USD 144,000 - 176,000
Medical, dental, and vision insurance
Equity Scheme
401(k) with employer match
+3
Cloud Platform Engineer: Kubernetes, Go & GPU Infra
Cloud Platform Engineer: Kubernetes, Go & GPU Infra

Baseten • United States

On-site
USD 150,000 - 230,000
Medical, dental, vision coverage
Flexible PTO incl. Winter Break
Parental leave
+3
AI Platform Engineer - GPU/Kubernetes Onsite
AI Platform Engineer - GPU/Kubernetes Onsite

AMroute LLC • St. Louis (MO)

On-site
USD 11,000 - 19,000
Platform Engineer
Platform Engineer

Harrison Clarke • San Francisco (CA)

On-site
USD 120,000 - 160,000