Senior AI Compute Platform Engineer (Kubernetes)

Arm Limited; Seattle (WA); Hybrid; USD 209,000 - 283,000; Full time

Job summary

Arm Limited is seeking a Software Engineer for the AI Compute Platform team in Seattle to design and build a secure, scalable platform for running AI workloads. You will create control-plane services, APIs, orchestration systems, and developer tools for distributed training and inference, collaborating with compute infrastructure teams and AI engineers.

You will build scalable backend services, implement Kubernetes controllers, and deliver secure multi-tenant capabilities.

Qualifications

• 5+ years of experience building distributed systems or production backend services.
• Experience with distributed ML training or inference systems.
• Strong programming skills in Go or Python.
• Knowledge of APIs, Kubernetes, containers, asynchronous processing, and relational databases.
• Ability to build clear interfaces and simplify infrastructure for engineers and researchers.
• Clear communication and a collaborative approach to problem-solving.
• Experience with Kubernetes operators, schedulers, resource management, or GitOps.
• Knowledge of RPC systems, PostgreSQL, Kafka, OpenTelemetry, Prometheus and Grafana.
• Familiarity with distributed AI platforms, inference serving, or frameworks such as PyTorch, Ray, or vLLM.
• Experience delivering developer tools or platform capabilities from early build through production.
• Technical leadership, mentoring experience, or an advanced degree or equivalent experience in a related field.

Responsibilities

• Build scalable backend services, APIs, and asynchronous workflows for managing AI workloads.
• Develop Kubernetes controllers that manage workload submission, recovery, and long-running service lifecycles.
• Deliver secure multi-tenant capabilities covering access, secrets, quotas, and auditability.
• Improve platform scalability, observability, reliability, and developer workflows.
• Partner across teams to deliver distributed training, evaluation, and inference capabilities while strengthening engineering quality.

Skills

Distributed systems

Go

Python

APIs

Clear communication

Tools

Kubernetes

PostgreSQL

Kafka

OpenTelemetry

Prometheus

Grafana

PyTorch

Ray

vLLM

Job description

Arm Limited is seeking a Software Engineer for the AI Compute Platform team in Seattle to design and build a secure, scalable platform for running AI workloads. You will create control-plane services, APIs, orchestration systems, and developer tools for distributed training and inference, collaborating with compute infrastructure teams and AI engineers.

You will build scalable backend services, implement Kubernetes controllers, and deliver secure multi-tenant capabilities.