Remote-First Senior Go Engineer, LLM on Kubernetes

Mirantis; Raleigh (NC); Remote; USD 140,000 - 190,000; Full time

Job summary

Mirantis is building an enterprise AI infrastructure product that lets organizations run and govern large language models on their own Kubernetes clusters. You will join a small senior team with broad ownership of the model-serving layer and its path to production.

Design and build LLM serving infrastructure on Kubernetes, including deployment, GPU scheduling, scaling, and lifecycle management. This remote-first role offers strong autonomy and opportunities to shape the engineering direction.

Qualifications

• 5+ years in infrastructure, platform, or distributed systems.
• Deep hands-on Kubernetes experience with production workloads and Helm charts.
• Experience with GPU workloads or LLM inference or adjacent systems.
• Strong Go programming; solid CI/CD and infrastructure-as-code skills.
• Familiar with AI-assisted development tools (Claude Code, OpenAI Codex).
• Remote-first, autonomous written-culture team experience.

Responsibilities

• Design and build LLM serving infrastructure on Kubernetes.
• Handle deployment, GPU scheduling, scaling, and model lifecycle management.
• Package the platform for enterprise environments using Helm-based installs and offline networks.
• Integrate the serving layer with API gateway, identity, and metering services.
• Build observability for GPU inference in production (metrics and telemetry).
• Contribute across a multi-service codebase and influence engineering direction via design docs.

Skills

Go programming

CI/CD

Infrastructure as code

Kubernetes expertise

Tools

Helm

Job description

Mirantis is building an enterprise AI infrastructure product that lets organizations run and govern large language models on their own Kubernetes clusters. You will join a small senior team with broad ownership of the model-serving layer and its path to production.

Design and build LLM serving infrastructure on Kubernetes, including deployment, GPU scheduling, scaling, and lifecycle management. This remote-first role offers strong autonomy and opportunities to shape the engineering direction.