Senior Engineer — GPU Infrastructure & MLOps

CloudData.Center

United States

Remote

USD 140,000 - 190,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Remote role
US or India locations

Job summary

CloudData.Center is hiring for a hands-on role to deploy and operate GPU infrastructure and platform environments that support AI workloads. You will manage cluster setup, networking, Kubernetes operations, and lifecycle support for client environments.

The role focuses on GPU server clusters, InfiniBand/Ethernet networking, and Kubernetes with GPU integration to run AI workloads efficiently.

Qualifications

  • Deploy and configure GPU server clusters and infrastructure.
  • Experience with InfiniBand and Ethernet networking for GPU workloads.
  • Strong Kubernetes operations experience including GPU resource integration and scheduling.
  • Ability to support infrastructure used for AI workloads.

Responsibilities

  • Install and configure GPU server clusters (e.g., DGX, HGX, vendor systems).
  • Set up InfiniBand and Ethernet networks for GPU workloads.
  • Deploy and manage Kubernetes clusters with GPU operators and device plugins.
  • Support client environments throughout the AI infrastructure lifecycle.

Skills

GPU cluster deployment
Kubernetes orchestration
InfiniBand/Ethernet networking
AI infrastructure support

Tools

Kubernetes
DGX/HGX hardware
GPU hardware

Job description

Role overview

Deploy and operate GPU infrastructure and the platform environments that support AI workloads. This hands-on engineering role covers cluster setup, networking, Kubernetes operations, and ongoing infrastructure lifecycle support for clients.


Responsibilities


  • Install and configure GPU server clusters, including DGX, HGX, and other vendor systems.

  • Set up InfiniBand and Ethernet networks for GPU workloads.

  • Deploy and manage Kubernetes clusters with GPU operators, device plugins, and scheduling.

  • Support client environments through the lifecycle of AI infrastructure.


Requirements


  • Practical experience deploying and configuring GPU servers and clusters.

  • Experience with InfiniBand and Ethernet networking in GPU environments.

  • Kubernetes operations experience, including GPU resource integration and scheduling.

  • Ability to support infrastructure used for AI workloads.


Benefits and work setup


  • Full-time, remote role; the listed locations are the United States or India.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Architect — AI Cloud & GPU Infrastructure
Principal Architect — AI Cloud & GPU Infrastructure

CloudData.Center • United States

Remote
USD 180,000 - 270,000
Senior GPU Infra Engineer for MLOps & Kubernetes
Senior GPU Infra Engineer for MLOps & Kubernetes

CloudData.Center • United States

Remote
USD 140,000 - 190,000
Remote role
US or India locations
Senior Site Reliability Engineer
Senior Site Reliability Engineer

andromeda • United States

Remote
USD 180,000 - 280,000
Member of Technical Staff - GPU Infrastructure
Member of Technical Staff - GPU Infrastructure

Prime Intellect • United States

Hybrid
USD 150,000 - 300,000
Remote work option
Equity incentives
Professional development budget
+2
Principal Solutions Architect
Principal Solutions Architect

nscaleoperationsukltd • United States

Hybrid
USD 180,000 - 260,000
Equity
Base pay + equity
Annual compensation reviews
+1
Infrastructure Operations Engineer
Infrastructure Operations Engineer

lightningai • United States

Remote
USD 160,000 - 200,000
Medical, dental, vision
401(k) matching
Unlimited PTO
+4
Senior GPU Infrastructure Engineer - AI Infrastructure
Senior GPU Infrastructure Engineer - AI Infrastructure

Hamilton Barnes • Texas

On-site
USD 120,000 - 160,000
Potential equity/bonus
Platform Engineer
Platform Engineer

Harrison Clarke • San Francisco (CA)

On-site
USD 120,000 - 160,000
Member of Technical Staff - GPU Infrastructure
Member of Technical Staff - GPU Infrastructure

Prime Intellect, Inc. • San Francisco (CA)

On-site
USD 150,000 - 300,000
Equity incentives
AI Infrastructure Platform Operations Engineer remote in the US
AI Infrastructure Platform Operations Engineer remote in the US

Mirantis • United States

Remote
USD 110,000 - 150,000
Professional development
Conferences attendance
Team events