Senior AI Compute Platform Engineer

Arm; Seattle (WA); Hybrid; USD 263,000 - 355,000; Full time

Job summary

Arm in Seattle is seeking a Principal Software Engineer on the AI Compute Platform team to design and build a secure, reliable, and easy-to-use platform for running AI workloads at scale.

You will develop control-plane services, APIs, orchestration systems, and developer tools for distributed training and inference, working closely with compute infrastructure teams, AI engineers, and internal users to improve reliability, scalability, and developer productivity across Arm’s AI workloads.

Qualifications

• 8+ years building distributed systems, cloud platforms, or production backend services.
• Experience with distributed ML training or inference systems.
• Strong programming skills in Go, Python, or similar systems languages.
• Practical knowledge of APIs, Kubernetes, containers, asynchronous processing, and relational databases.
• Ability to build clear interfaces and simplify infrastructure for engineers and researchers.
• Clear communication and a collaborative approach to problem-solving.

Responsibilities

• Build scalable backend services, APIs, and asynchronous workflows for managing AI workloads.
• Develop Kubernetes controllers that manage workload submission, recovery, and long-running service lifecycles.
• Deliver secure multi-tenant capabilities covering access, secrets, quotas, and auditability.
• Improve platform scalability, observability, reliability, and developer workflows.
• Partner across teams to deliver distributed training, evaluation, and inference capabilities while strengthening engineering quality.

Skills

Distributed systems

Kubernetes

Go

Python

APIs

Relational DBs

Cloud platforms

Communication

Tools

PostgreSQL

Kafka

OpenTelemetry

Prometheus

Grafana

Job description

Arm in Seattle is seeking a Principal Software Engineer on the AI Compute Platform team to design and build a secure, reliable, and easy-to-use platform for running AI workloads at scale.

You will develop control-plane services, APIs, orchestration systems, and developer tools for distributed training and inference, working closely with compute infrastructure teams, AI engineers, and internal users to improve reliability, scalability, and developer productivity across Arm’s AI workloads.