Senior Software Engineer

Mirantis

United States

Remote

USD 150,000 - 190,000

Full time

9 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Mirantis is building an enterprise AI infrastructure product to run and govern large language models on customers’ Kubernetes clusters. You will join a small senior team with broad ownership of the model-serving layer and its path to production.

You will design and implement LLM serving on Kubernetes, with deployment, GPU scheduling, scaling, and lifecycle management, while packaging for air-gapped environments via Helm-based installs and upgrades.

Qualifications

  • 5+ years of software engineering experience in infrastructure, platform, or distributed systems.
  • Deep hands-on Kubernetes experience: production workloads and Helm charts.
  • Strong Go programming skills; solid CI/CD and infrastructure-as-code skills.
  • Fluency with AI-assisted development tools (Claude Code, OpenAI Codex) as part of daily engineering workflow.
  • Comfortable with high autonomy on a small, remote-first, written-culture team.

Responsibilities

  • Design and build LLM serving infrastructure on Kubernetes: deployment, GPU scheduling, scaling, and model lifecycle management.
  • Package the platform for enterprise environments: Helm-based installs, upgrades, and restricted/offline networks.
  • Integrate the serving layer with the platform's API gateway, identity, and metering services.
  • Build the observability for operating GPU inference in production (serving metrics, GPU telemetry).
  • Contribute across a multi-service codebase and help set engineering direction through design docs and reviews.

Skills

Go programming
Kubernetes
CI/CD
Distributed systems
AI tooling

Tools

Helm
Infrastructure as code

Job description

Mirantis is building a new enterprise AI infrastructure product that lets organizations run and govern large language models on their own Kubernetes clusters. You will join a small senior team early, with broad ownership of the model-serving layer and its path to production.

What you\'ll do
  • Design and build LLM serving infrastructure on Kubernetes: deployment, GPU scheduling, scaling, and model lifecycle management.
  • Package the platform for enterprise environments: Helm-based installs, upgrades, and restricted/offline networks.
  • Integrate the serving layer with the platform\'s API gateway, identity, and metering services.
  • Build the observability for operating GPU inference in production (serving metrics, GPU telemetry).
  • Contribute across a multi-service codebase and help set engineering direction through design docs and reviews.
  • 5+ years of software engineering experience in infrastructure, platform, or distributed systems.
  • Deep hands-on Kubernetes experience: building and operating production workloads and Helm charts, not just consuming managed clusters.
  • Experience with GPU workloads or LLM inference, or strong adjacent systems experience and a track record of learning fast.
  • Strong Go programming skills; solid CI/CD and infrastructure-as-code skills.
  • Fluency with AI-assisted development tools (Claude Code, OpenAI Codex) as part of your daily engineering workflow.
  • Comfortable with high autonomy on a small, remote-first, written-culture team.
Nice to have
  • Inference performance work (quantization, batching, caching) or distributed serving frameworks.
  • Enterprise deployment experience: air-gapped installs, SSO/OIDC, supply-chain security.
  • UI development experience (e.g. React/TypeScript), useful as the product\'s management surfaces grow.
  • Open-source contributions in the Kubernetes or ML-infrastructure ecosystems.
Why you\'ll love Mirantis
  • Work with an established leader in the cloud infrastructure industry.
  • Work with exceptionally passionate, talented and engaging colleagues, helping Fortune 500 and Global 2000 customers implement next-generation cloud technologies.
  • Be a part of cutting-edge, open-source innovation.
  • Thrive in the high-energy environment of a young company where openness, collaboration, risk-taking, and continuous growth are valued.
  • Receive a competitive compensation package with strong benefits plan.

We are a Leader for Container Management in G2 (#2 after AWS)!

It is understood that Mirantis, Inc. may use automated decision-making technology (ADMT) for specific employment-related decisions. Opting out of ADMT use is requested for decisions about evaluation and review connected with the specific employment decision for the position applied for. You also have the right to appeal any decisions made by ADMT by sending your request to isamoylova@mirantis.com

By submitting your resume, you consent to the processing and storage of your personal data in accordance with applicable data protection laws, for the purposes of considering your application for current and future job opportunities.

We are a Leader for Container Management in G2 (#2 after AWS)!

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer
Senior Software Engineer

Mirantis • Raleigh (NC)

Remote
USD 140,000 - 190,000
Senior Software Engineer
Senior Software Engineer

Mirantis • Oregon

Hybrid
USD 150,000 - 190,000
Principal Software Engineer
Principal Software Engineer

Mirantis • Austin (TX)

Remote
USD 180,000 - 260,000
Senior Software Engineer, UI
Senior Software Engineer, UI

Mirantis • Raleigh (NC)

Remote
USD 120,000 - 180,000
Software Engineer, Infrastructure (Go) - remote in the EU
Software Engineer, Infrastructure (Go) - remote in the EU

Mirantis • United States

Remote
USD 140,000 - 190,000
Competitive compensation package
Strong benefits plan
Conferences and hackathons
+2
Consulting Architect
Consulting Architect

Digitailor • Austin (TX)

Remote
USD 150,000 - 210,000
Remote-first culture
Professional development
Software Engineer, Backend (Go)
Software Engineer, Backend (Go)

Mirantis • Raleigh (NC)

On-site
USD 90,000 - 130,000
Enterprise Account Executive, Strategic Accounts (Remote)
Enterprise Account Executive, Strategic Accounts (Remote)

Mirantis • United States

Remote
USD 180,000 - 260,000
Competitive compensation package
Strong benefits plan
Senior Software Engineer, UI
Senior Software Engineer, UI

Mirantis • Oregon

Hybrid
USD 130,000 - 180,000
Competitive compensation
Remote-friendly culture
Excellent benefits
Principal Software Engineer Software
Principal Software Engineer Software

Frontdoor Defense • Austin (TX)

Remote
USD 180,000 - 250,000
Competitive compensation
Strong benefits package
Open-source collaboration