Senior AI Compute Infra Engineer (Hybrid)

Arm Limited; Seattle (WA); Hybrid; USD 209,000 - 283,000; Full time

Benefits offered by this job

Relocation package

Recruitment accommodations

Job summary

Arm Limited is seeking an experienced AI Compute Infra engineer to design, build, and operate large-scale infrastructure for AI training, evaluation, and inference. You will work across Kubernetes clusters, accelerator enablement, workload scheduling, and high-performance networking, partnering with AI researchers to improve reliability and scalability.

The role involves supporting GPU and accelerator workloads, integrating drivers, and automating provisioning and monitoring.

Qualifications

• 5+ years of experience building or operating cloud, compute, HPC, or distributed infrastructure in a production environment.
• Programming experience in Go, Python, or another systems language, with an interest in developing reliable infrastructure software.
• Practical knowledge of Kubernetes, containers, Linux, networking, and storage.
• Experience supporting GPU, accelerator, or distributed machine-learning workloads.
• An ability to troubleshoot complex systems and communicate clearly with engineers from different technical backgrounds.

Responsibilities

• Build and operate Kubernetes clusters while improving workload scheduling, topology-aware placement, capacity use, and recovery.
• Enable new CPU and GPU systems by integrating and validating drivers, networking, storage, monitoring, and health checks.
• Investigate performance and reliability issues across applications, cloud infrastructure, clusters, and hardware, then turn findings into lasting improvements.
• Partner with AI teams to understand their workloads and automate cluster provisioning, upgrades, monitoring, and maintenance around their needs.

Skills

Kubernetes

Containers

Linux

Networking

Storage

Go

Python

Distributed infra

Tools

NVIDIA CUDA

NVLink

NCCL

EFA

DCGM

AWS EKS

Terraform

Argo CD

Helm

Prometheus

Grafana

Job description

Arm Limited is seeking an experienced AI Compute Infra engineer to design, build, and operate large-scale infrastructure for AI training, evaluation, and inference. You will work across Kubernetes clusters, accelerator enablement, workload scheduling, and high-performance networking, partnering with AI researchers to improve reliability and scalability.

The role involves supporting GPU and accelerator workloads, integrating drivers, and automating provisioning and monitoring.