Senior AI Platform Engineer: Scalable, Secure Runtime

Arm; Austin (TX); Hybrid; USD 162,000 - 219,000; Full time

Job summary

Arm is seeking a hands-on Platform Engineer to own and operate the runtime infrastructure for its AI platform. You will work across Kubernetes, cloud, identity, secrets, networking, telemetry, and incident management to deliver production-ready services at Arm scale.

You will design and implement secure, observable, scalable runtime patterns, automate provisioning and upgrades, and participate in on-call incident response to maintain reliability and cost efficiency.

Qualifications

• Familiarity with AI platform concepts such as model routing, MCP servers, agentic workflows, RAG systems or LLM observability.
• Strong experience deploying and operating production infrastructure or platform services in a Linux-based environment using Kubernetes, containers, cloud or private-cloud platforms, infrastructure-as-code and CI/CD/GitOps tooling.
• Strong automation and scripting skills, for example Terraform, Go, Python or similar.
• Experience with incident management, problem management, demand forecasting, and production readiness practices.
• Good understanding of security fundamentals for production platforms, including identity, secrets, access control, network segmentation, vulnerability management and audit logging.

Responsibilities

• Build, operate and continuously improve the production infrastructure for Arm’s AI platform services, using both custom and third party solutions.
• Own reliability, scalability, monitoring, alerting, incident response, runbooks and operational readiness for AI platform components.
• Develop automation for provisioning, deployment, configuration, backup, recovery, patching, upgrades and lifecycle management.
• Implement secure runtime patterns, including workload isolation, secrets management, identity integration, network controls and auditability.
• Participate in production support and our paid on-call rota for high impact incident response.

Skills

AI platform concepts

MCP servers

Agentic workflows

LLM observability

Tools

Kubernetes

Containers

Terraform

Go

Python

CI/CD/GitOps

Cloud

Job description

Arm is seeking a hands-on Platform Engineer to own and operate the runtime infrastructure for its AI platform. You will work across Kubernetes, cloud, identity, secrets, networking, telemetry, and incident management to deliver production-ready services at Arm scale.

You will design and implement secure, observable, scalable runtime patterns, automate provisioning and upgrades, and participate in on-call incident response to maintain reliability and cost efficiency.