Senior Software Engineer (Fully Remote)

Mirantis; United States; Remote; USD 140,000 - 220,000; Full time

Benefits offered by this job

Competitive compensation

Strong benefits package

Job summary

Mirantis in the United States is seeking an experienced infrastructure engineer to design and build the LLM serving stack on Kubernetes, including deployment, GPU scheduling, scaling, and model lifecycle management.

You will package the platform for enterprise environments with Helm-based installs and upgrades for restricted networks, and integrate the serving layer with the API gateway, identity, and metering services.

Qualifications

• 5+ years of software engineering experience in infrastructure, platform, or distributed systems.
• Deep hands-on Kubernetes experience: building and operating production workloads and Helm charts.
• Strong Go programming skills; solid CI/CD and infrastructure-as-code skills; fluency with AI-assisted development tools.

Responsibilities

• Design and build LLM serving infrastructure on Kubernetes, including deployment, GPU scheduling, scaling, and model lifecycle management.
• Package the platform for enterprise environments: Helm-based installs, upgrades, and restricted/offline networks.
• Integrate the serving layer with the platform's API gateway, identity, and metering services.

Skills

Go programming

CI/CD

Distributed systems

Tools

Kubernetes

Helm

CI/CD tooling

Infrastructure as code

Job description

• Design and build LLM serving infrastructure on Kubernetes, including deployment, GPU scheduling, scaling, and model lifecycle management.
• Package the platform for enterprise environments: Helm-based installs, upgrades, and restricted/offline networks.
• Integrate the serving layer with the platform's API gateway, identity, and metering services.

Qualifications:

• 5+ years of software engineering experience in infrastructure, platform, or distributed systems.
• Deep hands-on Kubernetes experience: building and operating production workloads and Helm charts.
• Strong Go programming skills; solid CI/CD and infrastructure-as-code skills; fluency with AI-assisted development tools.

Why you'll love Mirantis:

• Work with an established leader in cloud infrastructure and exceptionally talented colleagues.
• Be a part of cutting-edge, open-source innovation in a high-energy, collaborative environment.
• Receive a competitive compensation package with a strong benefits plan.

Mirantis is a Kubernetes-native AI infrastructure company that helps organizations build and operate scalable infrastructure for AI and data-intensive applications. With a culture of openness and collaboration, Mirantis is an established leader in cloud infrastructure, serving Fortune 500 and Global 2000 customers.