Senior MLOps Engineer — GPU Cluster Orchestration

Comet Cloud; Boston (MA); Hybrid; USD 120,000 - 180,000; Full time

Job summary

Comet Cloud in the Boston area is hiring a Cluster Operations Engineer to own MLOps and orchestration for GPU clusters, including NVIDIA hardware and software stacks. The role blends platform engineering with customer interaction, focusing on Kubernetes/Slurm orchestration, DCGM, NCCL, and maintaining control plane health while translating workload needs into cluster configurations.

Ideal candidates have production Kubernetes/Slurm experience, model training expertise, and a hands-on approach in

Qualifications

• Experience running Kubernetes and/or Slurm in production.
• Expertise in training models, workload orchestration, and optimizing core infrastructure.
• Familiarity with NVIDIA toolchain or willingness to learn.
• Ability to monitor and operate control plane infrastructure.
• Proven ability to write actionable runbooks.

Responsibilities

• Manage cluster lifecycle and orchestration for GPUs.
• Configure Kubernetes/Slurm for enterprise workloads.
• Maintain NVIDIA software stack (DCGM, Base Command Manager, NCCL).
• Engage with customer ML teams to translate workload needs.
• Monitor control plane health and performance.

Skills

Kubernetes

Slurm

NVIDIA tools

Model training

Performance tuning

Customer support

Tools

DCGM

Base Command Manager

NCCL

Infiniband

Job description

Comet Cloud in the Boston area is hiring a Cluster Operations Engineer to own MLOps and orchestration for GPU clusters, including NVIDIA hardware and software stacks. The role blends platform engineering with customer interaction, focusing on Kubernetes/Slurm orchestration, DCGM, NCCL, and maintaining control plane health while translating workload needs into cluster configurations.

Ideal candidates have production Kubernetes/Slurm experience, model training expertise, and a hands-on approach in