AI Platform Operations Engineer (L3)

Sharon AI, Inc; Sydney; Hybrid; AUD 160,000 - 240,000; Full time

Job summary

Sharon AI, Inc. seeks an experienced AI Platform Operations Engineer (L3) to own and evolve the GPU‑as‑a‑Service infrastructure powering enterprise AI workloads.

You’ll architect platform components across EMEA, leveraging Kubernetes, Slurm and GPU orchestration to enable training, fine-tuning and deployment at scale. This senior role requires hands‑on leadership, design of multi‑tenant scheduling, and end‑to‑end platform reliability, with a focus on automation, observability and cost

Qualifications

• Requires strong background in platform engineering for AI infra.
• Hands-on experience with GPU infrastructure and large-scale AI workloads.
• Experience with CI/CD, MLOps and model-serving environments.

Responsibilities

• Own and evolve AI platform architecture across EMEA GPU clusters (Kubernetes/Slurm).
• Lead CI/CD, MLOps and automation for AI workloads.
• Design multi-tenant GPU scheduling and workload isolation.
• Build high-performance, highly available model-serving infra.
• Drive monitoring, observability and GPU performance optimization.
• Implement IaC using Terraform and Ansible.
• Mentor engineers and support onboarding.

Job description

Sharon AI is an Australian neocloud, delivering trusted AI infrastructure organisations need to build, train and run AI at scale. We support customers across the full AI lifecycle, from training through to inference and agentic AI, drawing on a strong ecosystem of technology and co-location partners to deliver capability where it's needed. As the first neocloud to join NVIDIA's AI Compute Program, we're growing quickly, scaling our AI Factory platform to meet rising demand for advanced compute.

The Role

We’re seeking an experienced AI Platform Operations Engineer (L3), to own and evolve the platform powering SharonAI’s GPU-as-a-Service (GPUaaS) infrastructure across EMEA.

This is a senior, hands-on role where you’ll architect and optimise the platforms enabling enterprise customers to train, fine-tune and deploy AI models at scale, leveraging Kubernetes, Slurm, MLOps and GPU orchestration.

What You’ll Be Doing

• Own and evolve our AI platform architecture across EMEA GPU clusters, including Kubernetes, Slurm and container orchestration.
• Lead CI/CD, MLOps and automation for AI workloads.
• Design multi-tenant GPU scheduling, resource allocation and workload isolation.
• Build high-performance, highly available model-serving infrastructure.
• Drive platform monitoring, observability and GPU performance optimisation.
• Implement Infrastructure-as-Code using Terraform and Ansible.
• Partner with Network Engineering on InfiniBand/RDMA integration.
• Lead technical escalations, incident response and post-incident reviews.
• Drive capacity planning, scaling and cost optimisation.
• Mentor engineers and support enterprise GPUaaS customer onboarding and escalations.

What We’re Looking For

• Strong experience in platform engineering, AI infrastructure, cloud or distributed systems.
• Hands-on expertise in Kubernetes, Slurm and container orchestration.
• Understanding of GPU infrastructure and large-scale AI/ML workloads.
• Experience with CI/CD, MLOps and model-serving environments.
• Knowledge of multi-tenant architectures and GPU scheduling.
• Experience with Terraform, Ansible and Infrastructure-as-Code.
• Familiarity with InfiniBand and RDMA networking.
• Strong troubleshooting, observability and incident management capabilities.
• Ability to take ownership, work autonomously and provide technical leadership.

Please note:

This role requires availability to support incidents with technical expertise, which may involve working outside normal business hours.

Why Join Sharon AI?

You’ll be joining a rapidly growing Australian technology business at an exciting stage of its journey, with the opportunity to work directly with the infrastructure and technology powering the next generation of AI.

Hybrid working – flexibility between our office and working from home

Birthday leave – take some extra time to celebrate your day

Employee Assistance Program (EAP) – confidential support when you need it

Exposure to AI and next-generation technology – work in one of the fastest-moving areas of technology

Learning & development – we support your career growth with approved conferences, professional memberships & courses

Novated leasing – a tax-effective way to finance and run your car

Bounty referral program – generous rewards for successfully referring new talent to Sharon AI

Employee of the month – recognition plus a $500 gift card

Growing global business – be part of an Australian technology company with an expanding international footprint

Make an impact – join at a stage where your work can have a visible influence on how we build and grow

Collaborative culture – work alongside talented people across technical, commercial and corporate teams

Our Values

Integrity | Innovation | Collaboration | Wellbeing | Inclusion

Apply today and help us build the infrastructure powering the next generation of AI.

Due to the high volume of applications we receive, we’re unfortunately not always able to provide individual feedback to unsuccessful candidates. We appreciate your understanding and want to assure you that every application will be reviewed with care.