Senior AI Compute Infrastructure Architect

Arm Limited; Seattle (WA); Hybrid; USD 263,000 - 355,000; Full time

Benefits offered by this job

Relocation package

Visa sponsorship

Job summary

Arm is seeking a Principal Engineer on the AI Compute Infra team to design, build, and operate large-scale AI infrastructure for training, fine-tuning, evaluation, and inference. You will lead Kubernetes clusters, accelerator enablement, and workload scheduling alongside researchers and engineers.

You will improve reliability, performance, scalability and developer productivity, driving end-to-end operational excellence and impactful outcomes in a collaborative, fast-paced setting.

Qualifications

• 8+ years of experience building or operating cloud, compute, HPC, or distributed infrastructure in production.
• Programming in Go or Python or another systems language with focus on reliable infra software.
• Practical knowledge of Kubernetes, containers, Linux, networking, and storage.
• Experience supporting GPU, accelerator, or distributed ML workloads.
• Strong troubleshooting and cross-team communication skills.

Responsibilities

• Build and operate Kubernetes clusters with improved scheduling and capacity use.
• Enable new CPU/GPU systems by integrating drivers, networking, storage, and health checks.
• Investigate performance and reliability issues and turn findings into improvements.
• Partner with AI teams to automate provisioning, upgrades, monitoring, and maintenance.

Skills

Go

Python

Systems language

Kubernetes

Linux

Networking

Storage

GPU/accelerators

Troubleshooting

Tools

NVIDIA CUDA

Prometheus

Grafana

Terraform

Argo CD

Helm

AWS EKS

Job description

Arm is seeking a Principal Engineer on the AI Compute Infra team to design, build, and operate large-scale AI infrastructure for training, fine-tuning, evaluation, and inference. You will lead Kubernetes clusters, accelerator enablement, and workload scheduling alongside researchers and engineers.

You will improve reliability, performance, scalability and developer productivity, driving end-to-end operational excellence and impactful outcomes in a collaborative, fast-paced setting.