Principal AI Inference Cloud Architect

Arm Limited; Seattle (WA); Hybrid; USD 263,000 - 355,000; Full time

Job summary

Arm Limited is seeking a Principal Engineer for the AI Inference Cloud team to steer architecture and deliver scalable AI inference services. You will lead Kubernetes-driven workloads, ensure reliability, and influence across AI compute, Inference Runtime, and product teams.

You will mentor engineers, drive cross-team alignment, and contribute to the design and rollout of production-grade cloud capabilities for AI workloads in a hybrid environment.

Qualifications

• 8+ years of experience in distributed systems, cloud platforms, or production infrastructure.
• Deep production experience with Kubernetes, including controllers, operators, scheduling, networking, and lifecycle management.
• Strong software and production engineering skills in Go, C++, Rust, or Python.
• Track record leading complex technical initiatives while remaining hands-on.
• Ability to troubleshoot complex systems and communicate across teams.

Responsibilities

• Define and build the architecture for cloud-based AI inference services.
• Develop Kubernetes controllers and platform capabilities for workload deployment, scheduling, recovery, scaling, upgrades, and lifecycle management.
• Establish production practices for health validation, progressive rollout, rollback, observability, and service objectives.
• Lead production readiness reviews and resolve issues across services, Kubernetes, networking, and compute infrastructure.
• Lead design and build reviews, mentor engineers, and drive technical alignment across teams.

Skills

Kubernetes

Go

C++

Rust

Python

Distributed systems

Leadership

Observability

Tools

Kubernetes

Job description

Arm Limited is seeking a Principal Engineer for the AI Inference Cloud team to steer architecture and deliver scalable AI inference services. You will lead Kubernetes-driven workloads, ensure reliability, and influence across AI compute, Inference Runtime, and product teams.

You will mentor engineers, drive cross-team alignment, and contribute to the design and rollout of production-grade cloud capabilities for AI workloads in a hybrid environment.