AI Storage Architect for GPU Clusters & AI Factories

Northbridge Recruitment; Melbourne; On-site; AUD 180,000 - 240,000; Full time

Job summary

Northbridge Recruitment is seeking a Domain Architect – AI Storage to design, deploy and optimise HPC and AI storage infrastructure for large-scale GPU clusters and AI factories in Melbourne.

The role leads the storage component of AI deployments, defining repeatable architectures, integrating with Kubernetes/OpenShift, and delivering high-throughput NVMe-oF, GDS and S3 storage solutions, with hands-on delivery and performance tuning.

Qualifications

• Extensive experience delivering HPC/AI storage solutions.
• Hands-on with parallel file systems WEKA, Lustre, BeeGFS, GPFS.
• Experience designing storage for GPU clusters and AI workloads.
• Strong Linux storage and performance troubleshooting.
• Automation with Python, Ansible or Terraform.
• Knowledge of NVMe-oF, RDMA and S3/object storage.

Responsibilities

• Design, deploy and optimise HPC and AI storage for GPU clusters.
• Lead implementation of parallel file systems such as WEKA, Lustre, BeeGFS and GPFS.
• Architect high-throughput storage fabrics for AI training and inference.
• Implement NVMe-oF, GDS, NFS over RDMA and S3 object storage.
• Integrate storage with bare-metal servers, Linux compute nodes, Kubernetes and OpenShift.
• Configure CSI drivers, storage classes and persistent storage for AI workloads.
• Benchmark and troubleshoot storage performance using IOR, FIO and mdtest.
• Develop automated deployment and configuration processes using Python, Ansible or Terraform.
• Design data lifecycle and tiering strategies across high-performance NVMe, flash and object storage.
• Collaborate with compute and network architects to ensure end-to-end performance.
• Lead technical implementation, performance tuning, testing and validation.

Skills

High-performance storage design

HPC storage architecture

Storage for GPU clusters

Tools

WEKA

Lustre

BeeGFS

GPFS (IBM Spectrum Scale)

Pure Storage

NVMe-oF

NFS over RDMA

S3-compatible object storage

NVIDIA GPUDirect Storage

Job description

Northbridge Recruitment is seeking a Domain Architect – AI Storage to design, deploy and optimise HPC and AI storage infrastructure for large-scale GPU clusters and AI factories in Melbourne.

The role leads the storage component of AI deployments, defining repeatable architectures, integrating with Kubernetes/OpenShift, and delivering high-throughput NVMe-oF, GDS and S3 storage solutions, with hands-on delivery and performance tuning.