AI Platform Engineer — GPU Infrastructure & MLOps

Sharon AI, Inc; Sydney; On-site; AUD 120,000 - 180,000; Full time

Job summary

Sharon AI is building the GPU‑as‑a‑Service platform in a cutting‑edge AI infrastructure environment. The AI Platform Engineer L2 will help build, operate and support the platform layer powering Sharon AI's GPUaaS offering across Kubernetes, Slurm, and MLOps tooling.

Reporting to the Head of Operations, you will collaborate with Network Engineering and Infrastructure teams to automate provisioning, troubleshoot platform services, and enable customers to train and run AI/ML workloads securely and

Qualifications

• 2–4 years of experience in platform engineering, DevOps, MLOps or SRE, ideally supporting GPU or AI/ML workloads.
• Bachelor's degree in Computer Science or related field.
• Hands‑on production experience with Kubernetes.
• Experience with CI/CD and Infrastructure‑as‑Code.
• Solid understanding of Kubernetes and GPU scheduling frameworks, including Slurm, Kubernetes device plugins and NVIDIA GPU Operator.
• Experience with MLOps tooling and ML pipeline orchestration.
• Proficiency in scripting and automation using Python and Bash.
• Working knowledge of GPU infrastructure and distributed training concepts, including NCCL and data/model parallelism.
• Experience with observability tools such as Prometheus and Grafana.
• Understanding of Linux systems administration and networking fundamentals.
• Strong troubleshooting and problem‑solving skills.
• Strong communication and collaboration skills, with the ability to work across Infrastructure, Network Engineering and customer‑facing teams.
• Exposure to GPU‑based infrastructure or high‑performance computing environments.

Responsibilities

• Build and operate the AI platform layer, including Kubernetes, Slurm and container orchestration, supporting Sharon AI's GPU infrastructure
• Develop and maintain CI/CD pipelines for model training, fine‑tuning and inference workloads
• Implement and support MLOps tooling for experiment tracking, model registry and deployment
• Configure and manage multi‑tenant GPU resource scheduling and quota management across customer workloads
• Support model serving infrastructure for training and inference, ensuring reliability and performance
• Build monitoring, logging and alerting to track platform health, GPU utilisation and workload performance
• Automate platform provisioning and configuration using Infrastructure‑as‑Code tools such as Terraform and Ansible
• Collaborate with Network Engineering and Infrastructure teams to ensure the platform layer aligns with the underlying InfiniBand/RDMA fabric
• Troubleshoot platform‑level issues affecting customer AI/ML workloads
• Participate in on‑call rotations and incident response for platform‑related issues
• Contribute to platform documentation, runbooks and the internal knowledge base
• Support customer onboarding onto the GPUaaS platform, including workload configuration and troubleshooting

Skills

Kubernetes

CI/CD

Python

Bash

Linux

Troubleshooting

Communication

Multi-tenant GPU scheduling

MLOps

NVIDIA GPU Operator

NCCL

PyTorch

TensorFlow

Slurm

Terraform

Ansible

Education

Bachelor's degree in Computer Science

Tools

Kubernetes

Slurm

NVIDIA GPU Operator

CI/CD pipelines

Terraform

Ansible

MLflow

Kubeflow

Ray

Job description

Sharon AI is building the GPU‑as‑a‑Service platform in a cutting‑edge AI infrastructure environment. The AI Platform Engineer L2 will help build, operate and support the platform layer powering Sharon AI's GPUaaS offering across Kubernetes, Slurm, and MLOps tooling.

Reporting to the Head of Operations, you will collaborate with Network Engineering and Infrastructure teams to automate provisioning, troubleshoot platform services, and enable customers to train and run AI/ML workloads securely and