Senior AI Infra Engineer: LLM Serving on Kubernetes

Mirantis; EE. UU.; A distancia; USD 180.000 - 260.000; Jornada completa

Descripción de la vacante

Mirantis is seeking a senior infrastructure engineer to design and operate LLM serving infrastructure on Kubernetes, with emphasis on deployment, GPU scheduling, and model lifecycle management. You will package the platform for enterprise environments using Helm, integrate with API gateway, identity, and metering services, and build observability for GPU inference in production.

Join a remote-first, high-autonomy team contributing across a multi-service codebase and shaping engineering direction

Formación

• Design and build LLM serving infra on Kubernetes: deployment, GPU scheduling, scaling, model lifecycle management
• Package platform for enterprise: Helm-based installs, upgrades, offline networks
• Integrate serving layer with API gateway, identity, and metering services
• Build observability for operating GPU inference in production: metrics, telemetry
• Contribute across a multi-service codebase and help set engineering direction via design docs and reviews

Responsabilidades

• Deep hands-on Kubernetes experience: building and operating production workloads and Helm charts
• Strong Go programming skills; solid CI/CD and infrastructure-as-code skills
• Experience with GPU workloads or LLM inference, or strong adjacent systems experience and a track record of learning fast
• 5+ years of software engineering experience in infrastructure, platform, or distributed systems
• Comfortable with high autonomy on a small, remote-first, written-culture team
• Fluency with AI-assisted development tools (Claude Code, OpenAI Codex) as part of daily workflow
• Inference performance work (quantization, batching, caching) or distributed serving frameworks
• Enterprise deployment experience: air-gapped installs, SSO/OIDC, supply-chain security
• UI development experience (e.g. React/TypeScript)
• Open-source contributions in Kubernetes or ML-infrastructure ecosystems

Conocimientos

Kubernetes

Go

CI/CD

Infrastructure as Code

React/TypeScript

Open-source contributions

AI-assisted development tools

LLM inference

Distributed systems

UI development

Herramientas

Helm

Descripción del empleo

Mirantis is seeking a senior infrastructure engineer to design and operate LLM serving infrastructure on Kubernetes, with emphasis on deployment, GPU scheduling, and model lifecycle management. You will package the platform for enterprise environments using Helm, integrate with API gateway, identity, and metering services, and build observability for GPU inference in production.

Join a remote-first, high-autonomy team contributing across a multi-service codebase and shaping engineering direction