Senior Software Engineer, AI Infrastructure

Mirantis; United States; Remote; USD 190,000 - 230,000; Full time

Benefits offered by this job

Competitive compensation package

Professional development

Conferences and tech talks

Remote-first culture

Hackathons

Job summary

Mirantis is building an enterprise AI infrastructure product to run and govern large language models on customer Kubernetes clusters. Join a small senior team with broad ownership of the model-serving layer and its path to production.

You will design and implement LLM serving infrastructure, including deployment, GPU scheduling, scaling, and lifecycle management, while packaging for restricted/offline networks and ensuring enterprise readiness.

Qualifications

• 5+ years of software engineering experience in infra or distributed systems.
• Deep hands-on Kubernetes experience building/operating production workloads and Helm charts.
• Experience with GPU workloads or LLM inference or strong adjacent systems experience.
• Strong Go programming skills; solid CI/CD and infrastructure-as-code skills.
• Fluency with AI-assisted development tools (Claude Code, OpenAI Codex) as part of daily workflow.

Responsibilities

• Design and build LLM serving infrastructure on Kubernetes: deployment, GPU scheduling, scaling, and model lifecycle management.
• Package the platform for enterprise environments: Helm-based installs, upgrades, and restricted/offline networks.
• Integrate the serving layer with the platform's API gateway, identity, and metering services.
• Build observability for operating GPU inference in production (serving metrics, GPU telemetry).
• Contribute across a multi-service codebase and help set engineering direction through design docs and reviews.

Skills

Go programming

Kubernetes

Distributed systems

CI/CD pipelines

LLM inference

GPU workloads

Tools

Kubernetes

Helm

CI/CD pipelines

Job description

Senior Software Engineer, AI Infrastructure

• Full-time

Mirantis, an IREN company, is the Kubernetes-native AI infrastructure company, enabling organizations to build and operate scalable, secure, and sovereign infrastructure for modern AI, machine learning, and data-intensive applications. By combining open source innovation with deep expertise in Kubernetes orchestration, Mirantis empowers platform engineering teams to deliver composable, production-ready developer platforms across any environment - on-premises, in the cloud, at the edge, or in sovereign data centers. As enterprises navigate the growing complexity of AI-driven workloads, Mirantis delivers the automation, GPU orchestration, and policy-driven control needed to manage infrastructure with confidence and agility. Committed to open standards and freedom from lock-in, Mirantis ensures that customers retain full control of their infrastructure strategy. https://www.mirantis.com/

Mirantis is building a new enterprise AI infrastructure product that lets organizations run and govern large language models on their own Kubernetes clusters. You will join a small senior team early, with broad ownership of the model-serving layer and its path to production.

What you'll do

Design and build LLM serving infrastructure on Kubernetes: deployment, GPU scheduling, scaling, and model lifecycle management.

Package the platform for enterprise environments: Helm-based installs, upgrades, and restricted/offline networks.

Integrate the serving layer with the platform's API gateway, identity, and metering services.

Build the observability for operating GPU inference in production (serving metrics, GPU telemetry).

Contribute across a multi-service codebase and help set engineering direction through design docs and reviews.

What we're looking for

5+ years of software engineering experience in infrastructure, platform, or distributed systems.

Deep hands-on Kubernetes experience: building and operating production workloads and Helm charts, not just consuming managed clusters.

Experience with GPU workloads or LLM inference, or strong adjacent systems experience and a track record of learning fast.

Strong Go programming skills; solid CI/CD and infrastructure-as-code skills.

Fluency with AI-assisted development tools (Claude Code, OpenAI Codex) as part of your daily engineering workflow.

Comfortable with high autonomy on a small, remote-first, written-culture team.

Nice to have

Inference performance work (quantization, batching, caching) or distributed serving frameworks.

Enterprise deployment experience: air-gapped installs, SSO/OIDC, supply-chain security.

UI development experience (e.g. React/TypeScript), useful as the product's management surfaces grow.

Open-source contributions in the Kubernetes or ML-infrastructure ecosystems.

What does Mirantis offer you?

• Work with an established Silicon Valley leader in the cloud infrastructure industry;
• Work with exceptionally passionate, talented and engaging colleagues, helping Fortune 500 and Global 2000 customers implement next-generation cloud technologies;
• Be a part of cutting-edge, open-source innovation;
• Thrive in the high-energy environment of a young company where openness, collaboration, risk-taking, and continuous growth are valued;
• Professional development and training;
• Attend conferences and working groups;
• Company outings, happy hours, hackathons, and tech talks;
• Receive a competitive compensation package with a strong benefits plan.

By clicking the link above or any third-party link within this posting, you are leaving this site and going to a third-party website where the third-party website's terms and privacy policy apply