GPU Kubernetes Cluster Engineer

Qubrid

McLean (VA)

Hybrid

USD 140,000 - 200,000

Full time

47 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Qubrid AI in McLean, VA is seeking a hands-on GPU Kubernetes Cluster Engineer to deploy and manage production GPU clusters for AI workloads. You will own cluster automation, Helm chart development, and GitOps workflows.

The role requires deep Linux, Kubernetes, and container tooling expertise, with experience running multi-node clusters, NVIDIA GPU Operator, and high-availability designs. Remote work from the US is supported.

Qualifications

  • 4+ years of Linux systems administration experience.
  • 3+ years of hands-on Kubernetes administration.
  • Strong expertise with Kubernetes, kubeadm, containerd, Helm, Docker, and Linux (Ubuntu, Rocky Linux, RHEL).
  • Proven experience developing Helm charts and packaging apps for Kubernetes.
  • Experience automating cluster provisioning and day-2 operations.
  • Ability to run production Kubernetes clusters for AI workloads.

Responsibilities

  • Deploy and maintain production Kubernetes clusters for AI and GPU workloads.
  • Bootstrap multi-node clusters with kubeadm.
  • Configure scheduling, namespaces, quotas, node pools, taints, tolerations, and affinity rules.
  • Design multi-tenant environments and high availability.
  • Write production-grade Helm charts and automate deployments.
  • Automate provisioning, upgrades, and day-2 operations.
  • Develop with GitOps and IaC practices.

Skills

Kubernetes admin
Linux admin
kubeadm
containerd
Helm charts
Docker
Bash scripting
Python scripting
Git & IaC
Networking basics

Tools

Kubernetes
kubeadm
containerd
Helm
Docker

Job description

Company: Qubrid AI (McLean, Virginia, USA)Work Mode: Work from Home | Type: Full-timeExperience: 2+ years of relevant experience

Important Notes Before Applying
  • Read everything carefully. The requirements and screening questions are critical. Applications that do not answer them correctly and satisfactorily will be automatically rejected.
  • Work from home.
  • Full-time role: this position requires complete commitment. Candidates planning to work two or more jobs simultaneously, or seeking part-time work, should not apply - such applications will automatically rejected.
  • Working hours: late nights in India, until approximately 4 AM IST, to overlap with US working hours. Do not apply if this schedule does not work for you.
  • Compensation: depends on experience and current verifiable compensation (paychecks).
  • Experience: junior candidates with 2+ years of strong hands-on experience are suitable.
About Qubrid AI

Qubrid AI is building a full-stack AI infrastructure platform that combines GPU cloud, inference APIs, AI orchestration software, and enterprise AI infrastructure. Our platform powers AI workloads across cloud, hybrid, and on-prem environments using state-of-the-art NVIDIA technologies and open-source AI frameworks.

About the Role

We are looking for a hands-on GPU Kubernetes Cluster Engineer with deep Linux, Kubernetes, cluster automation, and Helm package development expertise to deploy, manage, automate, and optimize GPU clusters used for AI training and large-scale inference workloads.

This role is for someone who has operated real production Kubernetes clusters - not just run local demos or followed tutorials. You will build and run highly available Linux-based GPU clusters, write the Helm charts and automation that deploy them, and own reliability across the stack.

The ideal candidate is comfortable working across:

  • Linux-based GPU clusters for training and inference
  • Helm chart and package development for platform and AI workloads
  • Cluster automation for provisioning, upgrades, and day-2 operations
  • NVIDIA GPU Operator, drivers, CUDA, and container runtimes
  • Container networking, ingress, and high-performance networking
  • Persistent and distributed storage
  • Monitoring, logging, and alerting
  • GitOps and Infrastructure as Code

You will work closely with GPU engineers, AI platform teams, and customers to deliver reliable, scalable infrastructure for AI workloads.

Responsibilities
  • Deploy, configure, and maintain production Kubernetes clusters for AI and GPU workloads
  • Bootstrap and manage multi-node clusters using kubeadm
  • Configure Kubernetes scheduling, namespaces, resource quotas, node pools, taints, tolerations, and affinity rules
  • Design and operate multi-tenant Kubernetes environments
  • Configure high availability and perform cluster upgrades with minimal downtime
  • Manage container runtimes including containerd and Docker
  • Configure container networking and CNI plugins such as Calico or Cilium
  • Manage ingress controllers, load balancing, DNS, and TLS certificates
  • Design, write, and maintain production-grade Helm charts for platform services and AI workloads
  • Build reusable, parameterized charts with clean values structures, templates, helpers, and dependencies
  • Package GPU-enabled workloads (inference servers, model services, operators) as versioned Helm releases
  • Manage chart versioning, chart repositories, and release lifecycles (install, upgrade, rollback)
  • Implement chart testing, linting, and validation before release
  • Deploy and manage workloads using Helm, Operators, and GitOps methodologies
  • Automate cluster provisioning, configuration, and scaling end to end
  • Automate Kubernetes upgrades, node onboarding, and day-2 operations
  • Build automation using Ansible, Bash, and Python
  • Implement GitOps workflows for declarative cluster and application management
  • Apply Infrastructure as Code principles to make cluster builds repeatable and auditable
  • Reduce manual operational work through scripts, pipelines, and self-healing patterns
4. GPU Infrastructure
  • Build and operate Linux-based GPU clusters supporting training and inference environments
  • Install and manage NVIDIA GPU Operator, drivers, CUDA, and GPU-enabled container runtimes
  • Configure GPU scheduling, sharing, and partitioning for AI workloads
  • Collaborate with GPU engineers and AI platform teams to optimize infrastructure for inference and training
5. Storage, Networking & Observability
  • Manage persistent storage solutions and distributed file systems
  • Troubleshoot Kubernetes, Linux, networking, and storage issues across distributed systemsl
  • Implement cluster monitoring, logging, and alerting
  • Diagnose and resolve performance bottlenecks in GPU and cluster environments
6. Operations & Customer Deployments
  • Participate in customer deployments across cloud, hybrid, and on-prem environments
  • Provide operational support for production clusters
  • Write technical documentation, runbooks, and deployment guides
  • Take ownership of infrastructure from initial build through production operation and maintenance
Requirements
Must-Have
  • 4+ years of Linux systems administration experience
  • 3+ years of hands-on Kubernetes administration experience
  • Strong expertise with:
    • Kubernetes
    • kubeadm
    • containerd
    • Helm (including writing and maintaining your own charts)
    • Docker
    • Linux (Ubuntu, Rocky Linux, RHEL)
  • Proven experience developing Helm charts and packaging applications for Kubernetes
  • Experience automating cluster provisioning and operations
  • Experience deploying and managing multi-node clusters
  • Experience with NVIDIA GPU Operator and GPU-enabled Kubernetes environments
  • Solid understanding of:
    • Networking fundamentals
    • DNS
    • Load balancing
    • Ingress controllers
    • TLS certificates
    • High availability
  • Experience with container networking and CNI plugins such as Calico or Cilium
  • Strong scripting skills in Bash and Python
  • Familiarity with Git and Infrastructure as Code principles
  • Ability to troubleshoot distributed systems and performance issues
Preferred
  • Experience with GPU clusters and AI infrastructure
  • Knowledge of NVIDIA drivers, CUDA, MIG, and DCGM
  • Experience with KubeVirt and GPU virtualization
  • Familiarity with Ceph, Longhorn, OpenEBS, NFS, or other persistent storage solutions
  • Experience with monitoring and observability tools including:
    • Prometheus
    • Grafana
    • Loki
    • Alertmanager
  • Experience with ArgoCD, FluxCD, and GitOps workflows
  • Experience with Kubernetes Operators or custom controllers
  • Understanding of RDMA, RoCEv2, InfiniBand, and high-speed networking
  • Familiarity with Slurm and HPC environments
  • Experience with Rancher, OpenShift, or VMware Tanzu
  • Exposure to AI inference frameworks such as Triton, vLLM, SGLang, and TensorRT-LLM
Nice to Have
  • CKA (Certified Kubernetes Administrator), CKS, or RHCE certifications
  • Experience supporting H100, H200, B200, A100, or HGX-based clusters
  • Familiarity with SONiC networking and NVIDIA Spectrum switches
  • Experience operating clusters with hundreds or thousands of GPUs
  • Infrastructure automation using Terraform or Ansible
  • Experience with hybrid cloud environments
What You'll Work On
  • Large-scale GPU clusters for AI training and inference
  • Kubernetes-based AI platforms and multi-tenant environments
  • Helm charts and packaging for AI platform services and GPU workloads
  • Cluster automation and GitOps-driven operations
  • NVIDIA GPU Operator and containerized AI workloads
  • Distributed storage and high-performance networking
  • Hybrid cloud and on-prem AI deployments
  • Enterprise AI factories and next-generation GPU cloud infrastructure
What We're Looking For
  • Someone who has run production Kubernetes clusters, not just deployed to them
  • Someone who writes Helm charts and automation, not just installs existing ones
  • A strong troubleshooter who enjoys debugging complex distributed systems
  • An automation-first mindset - if it's done twice, it gets scripted
  • An ownership mentality with strong execution skills
  • Someone comfortable working across Linux, Kubernetes, networking, storage, and GPUs without heavy supervision
  • Someone who understands that reliable AI infrastructure requires more than spinning up a cluster - it requires thoughtful automation, packaging, observability, and operational discipline
Why Join Qubrid AI?

At Qubrid AI, you'll help build the infrastructure behind the next generation of AI. You'll work with cutting-edge GPU clusters, Kubernetes, and NVIDIA technologies to power AI applications at scale for enterprises and developers worldwide.

If you enjoy Linux, Kubernetes, automation, and solving complex infrastructure challenges, we'd love to hear from you.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Infra Engineer – SRE (Kubernetes)
AI Infra Engineer – SRE (Kubernetes)

Berrybytes • United States

On-site
USD 110,000 - 150,000
Remote GPU Kubernetes Platform Engineer
Remote GPU Kubernetes Platform Engineer

Qubrid • McLean (VA)

Hybrid
USD 140,000 - 200,000
Senior Software Engineer, Infrastructure Software for AI (Centralized AI Data Centers & Distrib[...]
Senior Software Engineer, Infrastructure Software for AI (Centralized AI Data Centers & Distrib[...]

Intelliswift • Sunnyvale (CA)

On-site
USD 120,000 - 150,000
Competitive salary
Health insurance
Flexible work hours
AI Kernel / Cluster Engineer
AI Kernel / Cluster Engineer

Blue Signal LLC. • Santa Clara (CA)

On-site
USD 150,000 - 210,000
AI / GPU Infrastructure Operations Architect
AI / GPU Infrastructure Operations Architect

Accrescent Group • San Francisco (CA)

On-site
USD 150,000 - 230,000
Senior Forward Deployed Solutions Engineer
Senior Forward Deployed Solutions Engineer

Jobgether • United States

Remote
USD 140,000 - 210,000
Fully remote within the United States
Access to advanced Kubernetes and GPU‑
Collaborative engineering culture
Reliability Engineer
Reliability Engineer

REALM • United States

Remote
USD 120,000 - 190,000
AI Infrastructure Engineer
AI Infrastructure Engineer

vCluster Labs • United States

Remote
USD 180,000 - 260,000
Competitive Salary
Platinum-Level Insurance
Flexible Working Schedule
+1
Cluster Design
Cluster Design

Blue Signal LLC. • San Francisco (CA)

On-site
USD 150,000 - 230,000
Principal Infrastructure Engineer, AI Cluster Performance & Validation
Principal Infrastructure Engineer, AI Cluster Performance & Validation

Nscale • Houston (TX), New York (NY), San Francisco (CA), Seattle (WA)

On-site
USD 180,000 - 240,000