GPU Platform Engineer – AI Neocloud & Multi-Tenant Infra

Sharon AI, Inc; Australia; Hybrid; AUD 140,000 - 200,000; Full time

Benefits offered by this job

Birthday leave

Employee Assistance Program (EAP)

Novated leasing

Bounty referral program

Employee of the month

Hybrid work model

Job summary

Sharon AI, Inc. is seeking a Platform Engineer (GPUaaS – AI Neocloud) to design and operate a scalable GPU-accelerated platform for AI workloads. You will implement Kubernetes-based orchestration, Slurm scheduling, and IaC with Ansible and Terraform, while driving observability and robust security.

You’ll collaborate with engineering and product teams to optimize performance and cost, and contribute to a culture of innovation in Australia’s growing AI infrastructure scene.

Qualifications

• 4–8+ years in platform engineering or SRE.
• Proven experience with Kubernetes and cloud-native infra at scale.
• Experience with GPU workloads, distributed systems, CI/CD and infrastructure automation.
• Strong communication and stakeholder management skills.
• Ability to manage competing priorities in a fast-paced environment.
• Proactive, collaborative and solutions-focused mindset.
• Strong focus on performance, cost optimisation, security and operational detail.
• Genuine interest in AI and what Sharon AI is building.

Responsibilities

• Design and operate a multi-tenant GPUaaS platform supporting AI workloads.
• Build GPU orchestration and scheduling systems using Kubernetes and Slurm.
• Manage high-performance Kubernetes clusters with GPU nodes and advanced workload scheduling.
• Develop Infrastructure-as-Code using Ansible and Terraform.
• Create self-service APIs, CLI tooling and portals for GPU provisioning.
• Build CI/CD pipelines for platform services and maintain observability and monitoring.
• Collaborate with teams on AI training and inference workflows.
• Optimise GPU utilisation, platform performance and cost efficiency.
• Own platform reliability, security and isolation across multi-tenant environments.

Skills

Kubernetes

Slurm

CI/CD

Terraform

Ansible

GPU workloads

Platform engineering

SRE

Cloud-native

Tools

CUDA

NCCL

Job description

Sharon AI, Inc. is seeking a Platform Engineer (GPUaaS – AI Neocloud) to design and operate a scalable GPU-accelerated platform for AI workloads. You will implement Kubernetes-based orchestration, Slurm scheduling, and IaC with Ansible and Terraform, while driving observability and robust security.

You’ll collaborate with engineering and product teams to optimize performance and cost, and contribute to a culture of innovation in Australia’s growing AI infrastructure scene.