Senior Kubernetes Engineer

Devopsroles; Dallas (TX); On-site; USD 140,000 - 180,000; Full time

Benefits offered by this job

Lunch stipend

Company-paid medical

Dental and Vision benefits

16 weeks parental leave

401(k) matching

Flexible benefits

Job summary

NorthMark Compute & Cloud (NMC²) in Dallas seeks a Senior Kubernetes Engineer to design and operate GPU-accelerated container platforms at scale for AI/ML, HPC, and data-intensive workloads across hybrid or on-prem environments.

You will work with NVIDIA and Kubernetes ecosystems, implement custom operators, improve scheduling, and integrate observability and security controls. Collaboration with HPC/ML/DevOps teams is essential to ensure high-throughput and multi-tenant performance.

Qualifications

• Extensive production-grade Kubernetes experience with GPU workloads.
• Experience with NVIDIA GPU Operator, MIG, and DCGM.
• Proficient in Go or Python for operators.
• Strong understanding of RBAC, namespaces and policy enforcement.
• Experience with GitOps pipelines (ArgoCD/FluxCD).

Responsibilities

• Architect Kubernetes clusters for GPU workloads using NVIDIA tools.
• Develop and maintain custom Kubernetes operators and controllers.
• Integrate NVIDIA device plugins and MIG into scheduling layer.
• Optimize GPU utilization with scheduler extensions and Slurm/Volcano.
• Collaborate with HPC/ML/DevOps teams for multi-tenant performance.
• Drive observability with Prometheus, Grafana, DCGM Exporter, OpenTelemetry.
• Maintain CI/CD pipelines for infrastructure with GitOps (ArgoCD/FluxCD) and Terraform.
• Contribute to IaC using Terraform, Helm, and Kustomize.
• Participate in performance tuning and production readiness reviews.

Skills

Kubernetes

NVIDIA GPUs

Go or Python

RBAC & security

GitOps

Prometheus/Grafana

DCGM

Tools

NVIDIA GPU Operator

Helm

Kustomize

ArgoCD

FluxCD

Terraform

Job description

The Company

NorthMark Compute & Cloud (NMC²)is backed by dedicated leadership and investment, with a clear mission as it operates at the bleeding edge of technology. Its goal is to scale and enhance the high-performance computing (HPC) and cloud infrastructure that supports its clients' research, production, and delivery, enabling breakthroughs that shape the industries of tomorrow. Its engineers build critical infrastructure to eliminate friction in scientific research, simulations, analysis, and decision-making, accelerating discovery and driving faster innovation.

The Position

We are seeking a highly skilled Senior Kubernetes Engineer to join our NMC2 office in Dallas.
In this role, you will design, implement, and optimise GPU-accelerated container platforms at scale, enabling high-performance workloads (AI/ML, HPC, LLM training) across hybrid or on-prem environments.
You will have deep expertise with both NVIDIA and Kubernetes ecosystems, including GPU scheduling, device plugins and custom operators.

Responsibilities

• Architecting and operating Kubernetes clusters optimised for GPU workloads, leveraging NVIDIA GPU Operator, Network Operator and DCGM
• Developing, deploying and maintaining custom Kubernetes operators and controllers to automate infrastructure services
• Integrating NVIDIA device plugins, Multi-Instance GPU (MIG) and GPU sharing features into the scheduling layer
• Optimising GPU utilisation and job placement through scheduler extensions, such as kube-scheduler plugins, Slurm and Volcano
• Collaborating with HPC, ML and DevOps teams to ensure multi-tenant, high-throughput cluster performance
• Driving observability and telemetry integrations using Prometheus, Grafana, DCGM Exporter and OpenTelemetry
• Implementing secure multi-user and multi-namespace GPU isolation, with RBAC and policy enforcement, such as OPA or Gatekeeper
• Maintaining CI/CD pipelines for Kubernetes infrastructure using GitOps, ArgoCD and FluxCD
• Contributing to infrastructure-as-code, using Terraform, Helm, and Kustomize
• Participating in performance tuning, incident response and production readiness reviews

Requirements

• Extensive experience with Kubernetes in production-grade environments and working with NVIDIA and Kubernetes, including GPU Operator, device plugin, NVML, MIG and DCGM
• Proficiency in Go or Python for operator development and Kubernetes controller logic
• Deep understanding of Kubernetes internals, including CRDs, RBAC, custom controllers and scheduler extensions
• Experience with GPU-intensive workloads, for example for LLMs, training pipelines and scientific computing
• Hands-on experience with Helm, Kustomize and GitOps workflows
• Familiarity with CNI plugins, especially NVIDIA CNI and Multus
• Experience with monitoring GPU metrics and cluster health using Prometheus and DCGM Exporter

It is impossible to list every requirement for, or responsibility of, any position. Similarly, we cannot identify all the skills a position may require since job responsibilities and the Company’s needs may change over time. Therefore, the above job description is not comprehensive or exhaustive. The Company reserves the right to adjust, add to or eliminate any aspect of the above description. The Company also retains the right to require all employees to undertake additional or different job responsibilities when necessary to meet business needs.

Must be legally authorized to work in the United States without the need for employer sponsorship, now or at any time in the future.

Benefits & Perks:

• Company-Paid Lunch Stipend: Lunch is provided via GrubHub
• Company-Paid Benefits: 100% Employer-Paid Medical in our High Deductible Health Plan, Dental and Vision benefits for employees and their families, 16 weeks of Paid Parental Leave, Employee Assistance Program, Life insurance, Short-Term Disability and Long-Term Disability
• 401(k): Company will match 100% of your contributions up to 6%
• Optional Employee-Paid Benefits: Medical insurance in our PPO plan and a variety of other benefits such as Health Savings Accounts (with Company Contribution!), Flexible Spending Accounts, Supplemental Life Insurance, Wellhub and more.
• Time Off: 25 days of Paid Time Off plus 12 company holidays

EQUAL OPPORTUNITY EMPLOYER

NORTHMARK STRATEGIES LLC IS AN EQUAL EMPLOYMENT OPPORTUNITY EMPLOYER. THE COMPANY'S POLICY IS NOT TO DISCRIMINATE AGAINST ANY APPLICANT OR EMPLOYEE BASED ON RACE, COLOR, RELIGION, NATIONAL ORIGIN, GENDER, AGE, SEXUAL ORIENTATION, GENDER IDENTITY OR EXPRESSION, MARITAL STATUS, MENTAL OR PHYSICAL DISABILITY, AND GENETIC INFORMATION, OR ANY OTHER BASIS PROTECTED BY APPLICABLE LAW. THE FIRM ALSO PROHIBITS HARASSMENT OF APPLICANTS OR EMPLOYEES BASED ON ANY OF THESE PROTECTED CATEGORIES.