Senior Cloud AI Inference Engineer

Arm Limited; Seattle (WA); Hybrid; USD 209,000 - 283,000; Full time

Benefits offered by this job

Relocation package

Visa sponsorship

Job summary

Arm seeks an engineer for its AI Inference Cloud team to define the technical direction and develop highly available, scalable services for running AI inference workloads.

You will guide architecture and actively contribute across Kubernetes orchestration, workload management, service delivery, and observability, partnering with AI compute, Inference Runtime, and product teams to enhance performance and usability of Arm's AI platform.

Qualifications

• 5+ years building distributed systems, cloud platforms, or production infrastructure.
• Deep production experience with Kubernetes, including controllers, operators, scheduling, resource management, networking, and workload lifecycle management.
• Strong software and production engineering skills in Go, C++, Rust, Python or similar, with reliable services, APIs, concurrency, observability, and incident response.
• Track record of leading complex technical initiatives while remaining hands-on across architecture, implementation, debugging, mentoring, and influencing direction.
• Ability to troubleshoot complex systems and communicate clearly across technical backgrounds.

Responsibilities

• Define and build the architecture for cloud-based AI inference services.
• Develop Kubernetes controllers and platform capabilities supporting workload deployment, scheduling, recovery, scaling, upgrades, and lifecycle management.
• Establish production practices for health validation, progressive rollout, rollback, observability, and service objectives, improving reliability and efficiency.
• Lead production readiness reviews and resolve issues across services, Kubernetes, networking, and compute infrastructure.
• Lead design and build reviews, mentor engineers, and drive technical alignment across teams.

Skills

Kubernetes production experience

Go / C++ / Rust / Python

Leadership of technical initiatives

Troubleshooting complex systems

Cross-team communication

Job description

Arm seeks an engineer for its AI Inference Cloud team to define the technical direction and develop highly available, scalable services for running AI inference workloads.

You will guide architecture and actively contribute across Kubernetes orchestration, workload management, service delivery, and observability, partnering with AI compute, Inference Runtime, and product teams to enhance performance and usability of Arm's AI platform.