GPU Platform Engineer — Scale AI with Kubernetes & Terraform

Waratah Recruitment Partners; Sydney; On-site; AUD 180,000 - 260,000; Full time

Job summary

Waratah Recruitment Partners is seeking a Platform/SRE engineer to build and operate a multi-tenant GPU-as-a-Service platform for AI workloads in Sydney. You will orchestrate GPUs with Kubernetes and Slurm, manage GPU-enabled clusters, and codify infrastructure with Terraform and Ansible.

You'll deliver self-service APIs, CI/CD pipelines, and portals for GPU provisioning, while driving monitoring, security, and cost efficiency across AI training and inference workloads.

Qualifications

• 4-8+ years in platform engineering or SRE.
• Deep experience with Kubernetes and cloud-native infrastructure at scale.
• Background in GPU workloads, distributed systems, CI/CD and automation.
• Strong communication and stakeholder skills.
• Comfortable juggling priorities in a fast-moving environment.
• Proactive, collaborative and solutions-focused.
• Sharp focus on performance, cost, security and operational detail.

Responsibilities

• Build and run a multi-tenant GPU-as-a-Service platform for AI workloads.
• Develop GPU orchestration and scheduling using Kubernetes and Slurm.
• Manage GPU-enabled Kubernetes clusters with advanced workload scheduling.
• Write Infrastructure-as-Code with Terraform and Ansible.
• Deliver self-service APIs, CLI tools and portals for GPU provisioning.
• Create CI/CD pipelines for platform services, backed by strong monitoring and observability.
• Work with teams across AI training and inference.
• Improve GPU utilisation, performance and cost efficiency.
• Own reliability, security and tenant isolation, including incident response and ongoing improvement.

Skills

Kubernetes

Slurm

GPU platforms

CI/CD

Terraform

Ansible

Cloud-native infra

Observability

Tools

Kubeflow

PyTorch

TensorFlow

Ray

Airflow

Job description

Waratah Recruitment Partners is seeking a Platform/SRE engineer to build and operate a multi-tenant GPU-as-a-Service platform for AI workloads in Sydney. You will orchestrate GPUs with Kubernetes and Slurm, manage GPU-enabled clusters, and codify infrastructure with Terraform and Ansible.

You'll deliver self-service APIs, CI/CD pipelines, and portals for GPU provisioning, while driving monitoring, security, and cost efficiency across AI training and inference workloads.