Senior AI Inference & Runtime Platform Engineer (Remote)

AZX; United States; Remote; USD 180,000 - 275,000; Full time

Benefits offered by this job

Equity

Health insurance

Flexible PTO

Remote-friendly with Seattle cluster

Job summary

AZX is seeking a senior platform engineer to own the layer where AI work happens: the machines, the isolation boundary, and the models running on them. You’ll write Rust in the morning, a Kubernetes controller after lunch, and a FastAPI control plane endpoint before you go home—building the fork engine, the guest agent, and the multi-substrate model lifecycle.

We’re looking for individuals who’ve built this class of stack, operated it at scale, or ideally both, with OSS releases and robust

Qualifications

• 5+ years of shipping production systems in a systems language.
• Rust is the house language, but polyglots welcome with Go/C/C++/Zig and Rust
• Experience operating Kubernetes workloads with controllers/operators, autoscaling, and node lifecycle.
• Experience deploying open-weight LLM serving infrastructure (vLLM/SGLang or similar).
• Ability to measure latency and explain performance with data.
• Familiarity with isolation tech (Firecracker, Kata, gVisor) and secrets management.

Responsibilities

• Manage the serving tier for open-weight models: engine deployment, per-model SLOs, upgrades and canaries.
• Administer the Kubernetes layer for inference and sandbox workloads: operators, CRDs, autoscaling, GPU scheduling, node lifecycle.
• Own the stateful data plane: vector stores for semantic memory and graph stores; ensure backup and tested restores.
• Oversee sandbox runtime and host‑side control plane: lifecycle, exec, snapshot/fork, teardown, metering, threat model.
• Direct the FastAPI control‑plane services, Terraform/OpenTofu, Bicep, and dashboards.
• Run the layer the backend services team builds on and read their dashboards.
• Manage open‑source posture: OSS-ready releases, documentation, reproducible builds.

Skills

Rust

Kubernetes

Threat modeling

LLM infra

Security practices

Async Rust

GPU infra

Tools

Kubebuilder

KEDA

Karpenter

CRDs

OpenTelemetry

Job description

AZX is seeking a senior platform engineer to own the layer where AI work happens: the machines, the isolation boundary, and the models running on them. You’ll write Rust in the morning, a Kubernetes controller after lunch, and a FastAPI control plane endpoint before you go home—building the fork engine, the guest agent, and the multi-substrate model lifecycle.

We’re looking for individuals who’ve built this class of stack, operated it at scale, or ideally both, with OSS releases and robust