Senior AI Compute Infrastructure Engineer

Arm Limited; Seattle (WA); Hybrid; USD 209,000 - 283,000; Full time

Benefits offered by this job

Relocation package incl. visa support

Hybrid work model

Job summary

Arm Limited is seeking an engineer for the AI Compute Infra team to design, build, and operate large-scale infrastructure for AI training, fine-tuning, evaluation, and inference.

You will work across Kubernetes clusters, accelerator enablement, workload scheduling, high-performance networking, storage, and capacity management, partnering with AI researchers and engineers to improve reliability, performance, scalability, and developer productivity.

Qualifications

• 8+ years in production cloud/compute infrastructure.
• Proficient in Go or Python and systems programming.
• Solid knowledge of Kubernetes, Linux, networking and storage.
• Experience supporting GPU/accelerator or distributed ML workloads.
• Strong troubleshooting and cross-team communication.

Responsibilities

• Design, build, and operate large-scale AI compute infra.
• Manage Kubernetes clusters, workload scheduling, and capacity.
• Integrate drivers, networking, storage, monitoring for accelerators.
• Collaborate with AI researchers to optimize reliability and performance.

Skills

Cloud infrastructure

Go programming

Python programming

Systems programming

Troubleshooting

Tools

Kubernetes

Containers

Linux

Networking

Storage

CUDA/NVIDIA techs

AWS EKS

Terraform

Argo CD

Helm

Prometheus

Grafana

Job description

Arm Limited is seeking an engineer for the AI Compute Infra team to design, build, and operate large-scale infrastructure for AI training, fine-tuning, evaluation, and inference.

You will work across Kubernetes clusters, accelerator enablement, workload scheduling, high-performance networking, storage, and capacity management, partnering with AI researchers and engineers to improve reliability, performance, scalability, and developer productivity.