Lead AI Compute Infra Engineer — Relocation & Visa

Arm; Seattle (WA); Hybrid; USD 263,000 - 355,000; Full time

Job summary

Arm is seeking a Principal Engineer to design, build, and operate large-scale AI compute infrastructure. You will guide Kubernetes clusters, accelerator enablement, and workload scheduling to support AI research, training, and inference with focus on reliability and performance.

You will partner with AI teams to automate provisioning, upgrades, monitoring, and maintenance, while scaling storage and networking for evolving workloads across hybrid environments.

Qualifications

• 8+ years of experience building or operating cloud, compute, HPC, or distributed infrastructure in a production environment.
• Programming experience in Go, Python, or another systems language, with an interest in developing reliable infrastructure software.
• Practical knowledge of Kubernetes, containers, Linux, networking, and storage.
• Experience supporting GPU, accelerator, or distributed machine-learning workloads.
• An ability to troubleshoot complex systems and communicate clearly with engineers from different technical backgrounds.

Responsibilities

• Build and operate Kubernetes clusters while improving workload scheduling, topology-aware placement, capacity use, and recovery.
• Enable new CPU and GPU systems by integrating and validating drivers, networking, storage, monitoring, and health checks.
• Investigate performance and reliability issues across applications, cloud infrastructure, clusters, and hardware, then turn findings into lasting improvements.
• Partner with AI teams to understand their workloads and automate cluster provisioning, upgrades, monitoring, and maintenance around their needs.

Skills

Go/Python programming

Kubernetes

Linux networking

Storage

GPU/accelerator ML workloads

Troubleshooting complex systems

Cross-team communication

Tools

NVIDIA CUDA

NVIDIA NVLink

NVIDIA NCCL

NVIDIA EFA

NVIDIA DCGM

AWS EKS

Terraform

Argo CD

Helm

Prometheus

Grafana

Job description

Arm is seeking a Principal Engineer to design, build, and operate large-scale AI compute infrastructure. You will guide Kubernetes clusters, accelerator enablement, and workload scheduling to support AI research, training, and inference with focus on reliability and performance.

You will partner with AI teams to automate provisioning, upgrades, monitoring, and maintenance, while scaling storage and networking for evolving workloads across hybrid environments.