Staff AI Compute Platform Engineer — Scalable ML Infra

Arm; Seattle (WA); Hybrid; USD 209,000 - 283,000; Full time

Job summary

Arm in Seattle is seeking a Software Engineer on the AI Compute Platform team to design and build a secure, scalable platform for running AI workloads. You will develop control-plane services, APIs, orchestration systems, and developer tools for distributed training and inference, collaborating with compute infrastructure, AI engineers, and researchers.

You will work on Kubernetes controllers, secure multi-tenant capabilities, and platform improvements to reliability and developer productivity.

Qualifications

• 5+ years of experience building distributed systems, cloud platforms, or production backend services.
• Experience with distributed ML training or inference systems
• Strong programming skills in Go, Python, or similar systems languages
• Practical knowledge of APIs, Kubernetes, containers, asynchronous processing, and relational databases.
• Ability to build clear interfaces and simplify infrastructure for engineers and researchers.
• Clear communication and a collaborative approach to problem-solving.

Responsibilities

• Build scalable backend services, APIs, and asynchronous workflows for managing AI workloads.
• Develop Kubernetes controllers that manage workload submission, recovery, and long-running service lifecycles.
• Deliver secure multi-tenant capabilities covering access, secrets, quotas, and auditability.
• Improve platform scalability, observability, reliability, and developer workflows.
• Partner across teams to deliver distributed training, evaluation, and inference capabilities while strengthening engineering quality.

Skills

Distributed systems

Distributed ML training/inference

Go / Python

APIs / Kubernetes / containers

Communication & collaboration

Education

Advanced degree or equivalent

Tools

Kubernetes

PostgreSQL

Kafka

OpenTelemetry

Prometheus

Grafana

PyTorch

Ray

vLLM

Job description

Arm in Seattle is seeking a Software Engineer on the AI Compute Platform team to design and build a secure, scalable platform for running AI workloads. You will develop control-plane services, APIs, orchestration systems, and developer tools for distributed training and inference, collaborating with compute infrastructure, AI engineers, and researchers.

You will work on Kubernetes controllers, secure multi-tenant capabilities, and platform improvements to reliability and developer productivity.