Senior AI Infrastructure Architect (Kubernetes/GPU)

Mirantis, Inc.; Austin (TX); Remote; USD 180,000 - 260,000; Full time

Job summary

Mirantis, Inc. is seeking a Principal Software Engineer to own architecture across AI gateway, control plane, model serving, and observability for hosted and installed editions.

You will lead gateway strategy, GPU scheduling/sharing, and LLM serving on Kubernetes, while driving Helm-based deployments and secure supply chains. You will mentor senior engineers, collaborate with partners and customers, and represent Mirantis in Kubernetes and ML-infrastructure communities, enabling autonomous,

Qualifications

• 10+ years in infrastructure or distributed systems, including several as technical lead.
• Shipped multi-service systems that enterprises run in production, including software they install themselves.
• Expert Kubernetes: operators, CRDs, scheduling, Helm, and debugging at scale.
• Production experience with GPU workloads, LLM inference or AI gateways
• Expert Go, strong Python, and solid CI/CD and infrastructure as code.
• Leads through writing and influence, uses AI-assisted development tools fluently, and thrives with autonomy on a distributed team.

Responsibilities

• Own the architecture across the AI gateway, control plane, model serving, identity, metering and observability, for hosted and installed editions.
• Lead the gateway strategy, including the data plane choice and policy-based routing with per-request metering and audit records.
• Set direction for LLM serving on Kubernetes: GPU scheduling and sharing, autoscaling, multi-tenant and disaggregated serving, and cost per token.
• Define how enterprises run the product: Helm installs and upgrades, air-gapped networks, preflight checks and supply-chain security.
• Run design reviews, make build vs. buy calls, and record decisions as ADRs.
• Build hands-on in the critical path, and mentor senior engineers, including on AI-assisted development.
• Work with design partners and customers, and represent Mirantis in the Kubernetes and ML-infrastructure communities.

Skills

Go

Python

CI/CD

IaC

Leadership

Tools

Kubernetes

Helm

CRDs

GPU workloads

Job description

Mirantis, Inc. is seeking a Principal Software Engineer to own architecture across AI gateway, control plane, model serving, and observability for hosted and installed editions.

You will lead gateway strategy, GPU scheduling/sharing, and LLM serving on Kubernetes, while driving Helm-based deployments and secure supply chains. You will mentor senior engineers, collaborate with partners and customers, and represent Mirantis in Kubernetes and ML-infrastructure communities, enabling autonomous,