Senior AI Inference Cloud Engineer - Kubernetes

Arm; Seattle (WA); Hybrid; USD 209,000 - 283,000; Full time

Benefits offered by this job

Relocation package with visa support

Job summary

Arm is seeking an engineer for the AI Inference Cloud team to shape technical direction and build highly available AI inference services. You will guide architecture, contribute to Kubernetes-based platform work, and collaborate with AI compute and product teams to improve performance and usability of Arm's AI platform.

You will lead architecture reviews, mentor engineers, and drive alignment across teams while delivering scalable, observable cloud workloads.

Qualifications

• 5+ years of experience building distributed systems or production infrastructure.
• Deep production experience with Kubernetes: controllers, operators, scheduling, and workload lifecycle management.
• Hands-on programming in Go, C++, Rust, Python, or similar language; strong emphasis on reliable services, observability, and incident response.

Responsibilities

• Define and build architecture for cloud-based AI inference services.
• Develop Kubernetes controllers and platform capabilities for workload deployment, scheduling, and lifecycle management.
• Establish production practices for health checks, progressive rollout, observability, and SLOs; improve reliability and efficiency.

Skills

Kubernetes

Go

C++

Rust

Python

Distributed systems

Tools

Kubernetes controllers

Job description

Arm is seeking an engineer for the AI Inference Cloud team to shape technical direction and build highly available AI inference services. You will guide architecture, contribute to Kubernetes-based platform work, and collaborate with AI compute and product teams to improve performance and usability of Arm's AI platform.

You will lead architecture reviews, mentor engineers, and drive alignment across teams while delivering scalable, observable cloud workloads.