Remote Senior AI Platform Engineer — Rust/Kubernetes

Provn; Seattle (WA); Remote; USD 180,000 - 260,000; Full time

Benefits offered by this job

Equity participation

Bonus eligibility based on performance

Comprehensive health insurance

Flexible paid time off

Job summary

AZX is seeking a Senior Software Engineer, AI Platform, to architect and manage core AI inference and runtime infrastructure. This full-time, remote role focuses on scalable deployment, secure code execution, and robust data planes, supporting clients across real estate, energy, logistics, and utilities.

The role emphasizes Rust, distributed systems, Kubernetes operators, and open-weight LLM serving with Terraform/OpenTofu/Bicep integration.

Qualifications

• 5+ years delivering production systems in a systems programming language, with significant Rust expertise.
• Strong experience managing production Kubernetes workloads, including autoscaling and GPU scheduling.
• Advanced security practices around isolation boundaries, namespaces, cgroups, seccomp, and hypervisors.

Responsibilities

• Manage and optimize the serving tier for open-weight AI models, including deployment, config, cold-start strategies and SLOs.
• Administer Kubernetes environments for inference and sandbox workloads, including operators and CRDs, autoscaling, and GPU scheduling.

Skills

Rust

Go

C/C++

Zig

Kubernetes

Python

FastAPI

Education

Bachelor’s degree

Master’s degree

Tools

Terraform

OpenTofu

Bicep

Kubebuilder

KEDA

Karpenter

OpenTelemetry

Job description

AZX is seeking a Senior Software Engineer, AI Platform, to architect and manage core AI inference and runtime infrastructure. This full-time, remote role focuses on scalable deployment, secure code execution, and robust data planes, supporting clients across real estate, energy, logistics, and utilities.

The role emphasizes Rust, distributed systems, Kubernetes operators, and open-weight LLM serving with Terraform/OpenTofu/Bicep integration.