Platform Engineer (GPUaaS – AI Neocloud)

Sharon AI, Inc; Sharon; Hybrid; AUD 120,000 - 180,000; Full time

Benefits offered by this job

Hybrid work option

Birthday leave

Employee Assistance Program (EAP)

Novated leasing

Employee of the month

Job summary

Sharon AI, Inc is seeking a Platform Engineer (GPUaaS – AI Neocloud) to design and operate a multi-tenant GPU-enabled platform for AI workloads. You will build orchestration with Kubernetes and Slurm, manage GPU-enabled clusters, and implement IaC with Ansible/Terraform.

You will collaborate with Infrastructure, Operations and Product teams to deliver scalable, secure, and cost-effective AI infrastructure at scale. A hybrid work model is offered across Australia.

Qualifications

• 4–8+ years in platform engineering or SRE.
• Strong experience with Kubernetes and cloud-native infra at scale.
• Experience with GPU workloads, distributed systems, CI/CD and infra automation.

Responsibilities

• Design and operate a multi-tenant GPUaaS platform for AI workloads.
• Build GPU orchestration and scheduling using Kubernetes and Slurm.
• Manage large Kubernetes clusters with GPU nodes and advanced scheduling.

Skills

Kubernetes

Container orchestration

Cloud-native infra

SRE experience

Stakeholder management

Performance & cost optimisation

AI/GPU workloads interest

Collaboration

Tools

Kubernetes

Slurm

Ansible

Terraform

CI/CD pipelines

Job description

Hybrid working (if near a Sharon office)

About Sharon AI

Sharon AI is an Australian neocloud, delivering trusted AI infrastructure organisations need to build, train and run AI at scale. We support customers across the full AI lifecycle, from training through to inference and agentic AI, drawing on a strong ecosystem of technology and co-location partners to deliver capability where it's needed. As the first neocloud to join NVIDIA's AI Compute Program, we're growing quickly, scaling our AI Factory platform to meet rising demand for advanced compute.

The Role

As Sharon AI continues to grow, we're looking for a talented Platform Engineer (GPUaaS – AI Neocloud) to join our Platform team and play an important role in building and operating our high-performance AI neocloud platform, reporting to our Head of Platform.

In this role, the Platform Engineer will help deliver scalable, reliable and cost-efficient GPU-as-a-Service for AI/ML workloads including training, fine-tuning and inference at scale. You'll work closely with fellow Platform engineers and developers, Infrastructure and Operations teams, and Product stakeholders, with exposure to cutting-edge technology at the forefront of AI infrastructure.

What You’ll Be Doing

• Design and operate a multi-tenant GPUaaS platform supporting AI workloads
• Build GPU orchestration and scheduling systems using Kubernetes and Slurm
• Manage high-performance Kubernetes clusters with GPU nodes and advanced workload scheduling
• Develop Infrastructure-as-Code using Ansible and Terraform
• Create self-service APIs, CLI tooling and portals for GPU provisioning
• Build CI/CD pipelines for platform services and maintain strong observability and monitoring
• Collaborate with other teams on AI training and inference workflows
• Optimise GPU utilisation, platform performance and cost efficiency
• Own platform reliability, security and isolation across multi-tenant environments, including incident response and continuous improvement

What We’re Looking For

• 4–8+ years’ experience in platform engineering or Site Reliability Engineering (SRE)
• Strong experience with Kubernetes, container orchestration and cloud-native infrastructure at scale
• Experience working with GPU workloads, distributed systems, CI/CD and infrastructure automation
• Strong communication and stakeholder management skills
• Ability to manage competing priorities in a fast-paced environment
• A proactive, collaborative and solutions-focused approach
• Strong attention to performance, cost optimisation, security and operational detail
• A genuine interest in AI, technology and what Sharon AI is building

Nice to have:

• Experience with GPUaaS or high-performance computing (HPC) platforms
• Knowledge of ML frameworks and platform technologies such as PyTorch, TensorFlow, Ray, Kubeflow or Airflow
• Understanding of GPU technologies such as CUDA and NCCL, with relevant cloud certifications desirable

Why Join Sharon AI?

You’ll be joining a rapidly growing Australian technology business at an exciting stage of its journey, with the opportunity to work directly with the infrastructure and technology powering the next generation of AI.

• Hybrid working – flexibility between our office and working from home
• Birthday leave – take some extra time to celebrate your day
• Employee Assistance Program (EAP) – confidential support when you need it
• Exposure to AI and next-generation technology – work in one of the fastest-moving areas of technology
• Learning & development – we support your career growth with approved conferences, professional memberships & courses
• Novated leasing – a tax-effective way to finance and run your car
• Bounty referral program – generous rewards for successfully referring new talent to Sharon AI
• Employee of the month – recognition plus a $500 gift card
• Growing global business – be part of an Australian technology company with an expanding international footprint
• Make an impact – join at a stage where your work can have a visible influence on how we build and grow
• Collaborative culture – work alongside talented people across technical, commercial and corporate teams

Our Values

Integrity | Innovation | Collaboration | Wellbeing | Inclusion

Due to the high volume of applications we receive, we’re unfortunately not always able to provide individual feedback to unsuccessful candidates. We appreciate your understanding and want to assure you that every application will be reviewed with care.