AI Platform Engineer - Distributed Systems Lead

Arm Limited; Seattle (WA); Hybrid; USD 263,000 - 355,000; Full time

Job summary

Arm Limited in Seattle is seeking a Principal Software Engineer for the AI Compute Platform. You will design and build a secure, scalable platform to run AI workloads, developing control-plane services, APIs, orchestration systems, and developer tools for distributed training and inference.

You will collaborate with compute infrastructure teams, AI engineers, and internal users to improve reliability, scalability, and developer productivity across Arm's AI workloads.

Qualifications

• 8+ years building distributed systems or cloud platforms.
• Experience with distributed ML training or inference.
• Strong programming skills in Go, Python, or similar.
• Knowledge of APIs, Kubernetes, containers, async processing, and relational databases.
• Ability to build clear interfaces and simplify infrastructure for engineers and researchers.
• Excellent collaboration and communication.

Responsibilities

• Build scalable backend services, APIs, and asynchronous workflows for managing AI workloads.
• Develop Kubernetes controllers for workload submission and lifecycle management.
• Deliver secure multi-tenant capabilities for access, secrets, quotas, and auditability.
• Improve platform scalability, observability, reliability, and developer workflows.
• Partner across teams to deliver distributed training, evaluation, and inference capabilities.

Skills

Distributed systems

Go/Python

APIs & backend

Communication

Tools

Kubernetes

PostgreSQL

Kafka

OpenTelemetry

Prometheus

Grafana

PyTorch

Ray

vLLM

Job description

Arm Limited in Seattle is seeking a Principal Software Engineer for the AI Compute Platform. You will design and build a secure, scalable platform to run AI workloads, developing control-plane services, APIs, orchestration systems, and developer tools for distributed training and inference.

You will collaborate with compute infrastructure teams, AI engineers, and internal users to improve reliability, scalability, and developer productivity across Arm's AI workloads.