Platform Engineer (GPUaaS – AI Neocloud)

Sharon AI, Inc; Australia; Hybrid; AUD 140,000 - 200,000; Full time

Benefits offered by this job

Birthday leave

Employee Assistance Program (EAP)

Novated leasing

Bounty referral program

Employee of the month

Hybrid work model

Job summary

Sharon AI, Inc. is seeking a Platform Engineer (GPUaaS – AI Neocloud) to design and operate a scalable GPU-accelerated platform for AI workloads. You will implement Kubernetes-based orchestration, Slurm scheduling, and IaC with Ansible and Terraform, while driving observability and robust security.

You’ll collaborate with engineering and product teams to optimize performance and cost, and contribute to a culture of innovation in Australia’s growing AI infrastructure scene.

Qualifications

• 4–8+ years in platform engineering or SRE.
• Proven experience with Kubernetes and cloud-native infra at scale.
• Experience with GPU workloads, distributed systems, CI/CD and infrastructure automation.
• Strong communication and stakeholder management skills.
• Ability to manage competing priorities in a fast-paced environment.
• Proactive, collaborative and solutions-focused mindset.
• Strong focus on performance, cost optimisation, security and operational detail.
• Genuine interest in AI and what Sharon AI is building.

Responsibilities

• Design and operate a multi-tenant GPUaaS platform supporting AI workloads.
• Build GPU orchestration and scheduling systems using Kubernetes and Slurm.
• Manage high-performance Kubernetes clusters with GPU nodes and advanced workload scheduling.
• Develop Infrastructure-as-Code using Ansible and Terraform.
• Create self-service APIs, CLI tooling and portals for GPU provisioning.
• Build CI/CD pipelines for platform services and maintain observability and monitoring.
• Collaborate with teams on AI training and inference workflows.
• Optimise GPU utilisation, platform performance and cost efficiency.
• Own platform reliability, security and isolation across multi-tenant environments.

Skills

Kubernetes

Slurm

CI/CD

Terraform

Ansible

GPU workloads

Platform engineering

SRE

Cloud-native

Tools

CUDA

NCCL

Job description

Hybrid working (if near a Sharon office)

About Sharon AI

Sharon AI is an Australian neocloud, delivering trusted AI infrastructure organisations need to build, train and run AI at scale. We support customers across the full AI lifecycle, from training through to inference and agentic AI, drawing on a strong ecosystem of technology and co-location partners to deliver capability where it's needed. As the first neocloud to join NVIDIA's AI Compute Program, we're growing quickly, scaling our AI Factory platform to meet rising demand for advanced compute.

The Role

As Sharon AI continues to grow, we're looking for a talented Platform Engineer (GPUaaS – AI Neocloud) to join our Platform team and play an important role in building and operating our high-performance AI neocloud platform, reporting to our Head of Platform.

In this role, the Platform Engineer will help deliver scalable, reliable and cost-efficient GPU-as-a-Service for AI/ML workloads including training, fine-tuning and inference at scale. You'll work closely with fellow Platform engineers and developers, Infrastructure and Operations teams, and Product stakeholders, with exposure to cutting-edge technology at the forefront of AI infrastructure.

What You’ll Be Doing

• Design and operate a multi-tenant GPUaaS platform supporting AI workloads
• Build GPU orchestration and scheduling systems using Kubernetes and Slurm
• Manage high-performance Kubernetes clusters with GPU nodes and advanced workload scheduling
• Develop Infrastructure-as-Code using Ansible and Terraform
• Create self-service APIs, CLI tooling and portals for GPU provisioning
• Build CI/CD pipelines for platform services and maintain strong observability and monitoring
• Collaborate with other teams on AI training and inference workflows
• Optimise GPU utilisation, platform performance and cost efficiency
• Own platform reliability, security and isolation across multi-tenant environments, including incident response and continuous improvement

What We’re Looking For

• 4–8+ years’ experience in platform engineering or Site Reliability Engineering (SRE)
• Strong experience with Kubernetes, container orchestration and cloud-native infrastructure at scale
• Experience working with GPU workloads, distributed systems, CI/CD and infrastructure automation
• Strong communication and stakeholder management skills
• Ability to manage competing priorities in a fast-paced environment
• A proactive, collaborative and solutions-focused approach
• Strong attention to performance, cost optimisation, security and operational detail
• A genuine interest in AI, technology and what Sharon AI is building

Nice to have:

• Experience with GPUaaS or high-performance computing (HPC) platforms
• Knowledge of ML frameworks and platform technologies such as PyTorch, TensorFlow, Ray, Kubeflow or Airflow
• Understanding of GPU technologies such as CUDA and NCCL, with relevant cloud certifications desirable

Why Join Sharon AI?

You'll be joining a rapidly growing Australian technology business at an exciting stage of its journey, with the opportunity to work directly with the infrastructure and technology powering the next generation of AI.

Hybrid working – flexibility between our office and working from home

Birthday leave – take some extra time to celebrate your day

Employee Assistance Program (EAP) – confidential support when you need it

Exposure to AI and next-generation technology – work in one of the fastest-moving areas of technology

Learning & development – we support your career growth with approved conferences, professional memberships & courses

Novated leasing – a tax-effective way to finance and run your car

Bounty referral program – generous rewards for successfully referring new talent to Sharon AI

Employee of the month – recognition plus a $500 gift card

Growing global business – be part of an Australian technology company with an expanding international footprint

Make an impact – join at a stage where your work can have a visible influence on how we build and grow

Collaborative culture – work alongside talented people across technical, commercial and corporate teams

Our Values

Integrity | Innovation | Collaboration | Wellbeing | Inclusion

Due to the high volume of applications we receive, we’re unfortunately not always able to provide individual feedback to unsuccessful candidates. We appreciate your understanding and want to assure you that every application will be reviewed with care.