Cloud AI Inference Platform Architect

Arm; Seattle (WA); Hybrid; USD 263,000 - 355,000; Full time

Benefits offered by this job

Relocation package with visa Spons.&

Hybrid working options

Job summary

Arm is seeking a Principal Engineer for the AI Inference Cloud team to shape technical direction and build highly available, scalable AI inference services. You will guide architecture, develop Kubernetes Controllers, and drive platform reliability across multiple compute and networking domains.

The role requires 8+ years in distributed systems, strong Kubernetes experience, and hands-on programming in Go/C++/Rust/Python. Relocation/visa support is available.

Qualifications

• 8+ years of experience building distributed systems, cloud platforms, or production infrastructure.
• Deep production experience with Kubernetes controllers, operators, scheduling, and workload lifecycle management.
• Strong software and production engineering skills in Go, C++, Rust, Python, APIs, observability, and incident response.
• Track record of leading complex technical initiatives while staying hands-on and influencing direction.

Responsibilities

• Define and build architecture for cloud-based AI inference services.
• Develop Kubernetes controllers and platform capabilities for workload deployment, scheduling, and lifecycle management.
• Establish production practices for health checks, progressive rollout, rollback, observability, and reliability improvements.
• Lead production readiness reviews and resolve issues across services, Kubernetes, networking, and compute infrastructure.
• Lead design and code reviews, mentor engineers, and drive technical alignment across teams.

Skills

Kubernetes

Go

C++

Rust

Python

Distributed systems

Leadership

Job description

Arm is seeking a Principal Engineer for the AI Inference Cloud team to shape technical direction and build highly available, scalable AI inference services. You will guide architecture, develop Kubernetes Controllers, and drive platform reliability across multiple compute and networking domains.

The role requires 8+ years in distributed systems, strong Kubernetes experience, and hands-on programming in Go/C++/Rust/Python. Relocation/visa support is available.