GPU Infrastructure Engineer | Datacenter Ops

Prime Intellect

United States

Remote

USD 150,000 - 300,000

Full time

6 days ago
Be an early applicant
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Job summary

Prime Intellect seeks an experienced Infrastructure Operations Engineer to own the operational readiness of the physical infrastructure behind our GPU cloud. You will coordinate rack deployments, cabling, maintenance, and incident response with datacenter partners to deliver dependable production capacity.

You’ll lead hardware fault triage, maintain asset records, and partner with facility teams on power, cooling, and readiness for high-density deployments, while building runbooks and automating

Qualifications

  • 3+ years in datacenter operations, hardware infrastructure, or production systems operations.
  • Hands‑on experience deploying and troubleshooting rack-mounted servers, networking equipment, and cabling.
  • Experience coordinating datacenter providers, remote hands, and hardware vendors.
  • Working knowledge of Linux diagnostics, BMC consoles, and server hardware health tools.
  • Strong ownership, documentation habits, and incident resolution.

Responsibilities

  • Coordinate rack deployment, cabling, inventory, and acceptance testing for new GPU capacity with datacenter partners and engineering teams.
  • Maintain asset records, rack layouts, power allocations, cabling docs, and spare-parts inventories.
  • Lead hardware fault triage and coordinate remote hands, vendor escalations, component replacement, and RMA workflows.
  • Establish maintenance plans and change procedures to minimize customer disruption and protect equipment.
  • Track capacity readiness, repair times, and operational risks; automate reporting and workflows.
  • Partner with facility teams on power, cooling, environmental monitoring, and readiness for high-density GPUs.
  • Create runbooks and escalation procedures; support incident response across datacenter and infrastructure teams.

Skills

Datacenter operations
Rack wiring
Linux diagnostics
Vendor coordination
Incident management
Documentation

Tools

BMC consoles
Server health tools

Job description

Prime Intellect seeks an experienced Infrastructure Operations Engineer to own the operational readiness of the physical infrastructure behind our GPU cloud. You will coordinate rack deployments, cabling, maintenance, and incident response with datacenter partners to deliver dependable production capacity.

You’ll lead hardware fault triage, maintain asset records, and partner with facility teams on power, cooling, and readiness for high-density deployments, while building runbooks and automating

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

GPU Cloud Infrastructure Engineer
GPU Cloud Infrastructure Engineer

Prime Intellect • San Francisco (CA)

On-site
USD 150,000 - 300,000
Senior GPU Cloud Operations Engineer
Senior GPU Cloud Operations Engineer

AI Chopping Block • San Francisco (CA), Northern (KY)

On-site
USD 150,000 - 300,000
Staff Engineer - Bare-Metal & GPU Fleet Provisioning
Staff Engineer - Bare-Metal & GPU Fleet Provisioning

Prime Intellect • United States

On-site
USD 150,000 - 300,000
Staff Engineer, Bare-Metal GPU Fleet Provisioning
Staff Engineer, Bare-Metal GPU Fleet Provisioning

Prime Intellect • San Francisco (CA)

On-site
USD 150,000 - 300,000
Staff Network Engineer — GPU Data Center & HPC Networking
Staff Network Engineer — GPU Data Center & HPC Networking

Matcha • Northern (KY)

Hybrid
USD 150,000 - 300,000
Staff Datacenter Networking Engineer for GPU Infra
Staff Datacenter Networking Engineer for GPU Infra

Prime Intellect • United States

On-site
USD 150,000 - 300,000
Staff Engineer, GPU Infrastructure & Automation
Staff Engineer, GPU Infrastructure & Automation

Matcha • Northern (KY)

Hybrid
USD 150,000 - 300,000
Member of Technical Staff - Datacenter Operations
Member of Technical Staff - Datacenter Operations

Prime Intellect • San Francisco (CA)

On-site
USD 150,000 - 300,000
Member of Technical Staff - Datacenter Operations
Member of Technical Staff - Datacenter Operations

Prime Intellect AI • San Francisco (CA)

On-site
USD 150,000 - 300,000
Member of Technical Staff - Datacenter Operations
Member of Technical Staff - Datacenter Operations

AI Chopping Block • San Francisco (CA), Northern (KY)

Hybrid
USD 150,000 - 300,000