AI Compute Lead

Ample Industries (Formerly Vortx)

Santa Monica (CA)

On-site

USD 180,000 - 280,000

Full time

9 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Ample Industries (Formerly Vortx) is seeking a hands-on leader to own the GPU stack across inference clusters on our power systems. You will design reference architectures, bring up racks and validate compute at each site, and oversee day-to-day operations.

You will drive cluster performance, manage uptime, thermal and power limits, and enable inference serving for API platform customers. Collaboration with the energy team will include co-designing load profiles and ride-through strategies.

Qualifications

  • Experience deploying and operating GPU clusters at scale.
  • Deep knowledge of inference serving and high-performance networking.
  • Fluency in high-density power and cooling requirements.
  • Experience serving external inference customers.
  • Battery, microgrid or DC power experience is a plus.

Responsibilities

  • Define reference architectures from NVL72-class racks down to smaller nodes.
  • Rack, stack, power on and validate compute at each site.
  • Run cluster operations: utilization, uptime, thermal and power limits.
  • Enable inference serving for API platform customers, including scheduling and tenancy.
  • Co-design load profiles and battery ride-through with the energy team.
  • Own GPU, networking and integration vendors.

Skills

GPU clusters
Inference serving
InfiniBand/RoCE
Multi-tenancy
Power & cooling
External customers

Job description

You’ll own the GPU stack at every site: node design, bring-up and day-to-day operation of the inference clusters running on our power systems.

What you’ll do
  • Define reference architectures from NVL72-class racks down to smaller nodes
  • Rack, stack, power on and validate compute at each site
  • Run cluster operations: utilization, uptime, thermal and power limits
  • Enable inference serving for API platform customers, including scheduling and tenancy
  • Co-design load profiles and battery ride-through with the energy team
  • Own GPU, networking and integration vendors
What we’re looking for
  • Hands-on experience deploying and operating GPU clusters at scale
  • Deep knowledge of inference serving, InfiniBand/RoCE and multi-tenancy
  • Working fluency in high-density power and cooling
  • Experience serving external inference customers
  • Battery, microgrid or DC power experience is a plus
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GPU Compute Lead - Scale Inference Clusters & Power
GPU Compute Lead - Scale Inference Clusters & Power

Ample Industries (Formerly Vortx) • Santa Monica (CA)

On-site
USD 180,000 - 280,000
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)

Wwshemi • United States

Remote
USD 180,000 - 260,000
Senior GPU Infra Engineer: AI Clusters & OpenStack Lead
Senior GPU Infra Engineer: AI Clusters & OpenStack Lead

Hamilton Barnes • Texas

On-site
USD 120,000 - 160,000
Potential equity/bonus
Head of Inference Infrastructure
Head of Inference Infrastructure

General Compute • San Francisco (CA)

On-site
USD 190,000 - 280,000
Head of Infrastructure
Head of Infrastructure

General Compute • San Francisco (CA)

On-site
USD 190,000 - 280,000
Remote - Lead GPU Cluster Solutions Architect
Remote - Lead GPU Cluster Solutions Architect

Orion Placement • United States

Remote
USD 180,000 - 240,000
Bonus
Equity
Remote work (nationwide)
AI Network Engineer
AI Network Engineer

AMSYS Innovative Solutions, LLC • Houston (TX)

On-site
USD 150,000 - 190,000
Member of Technical Staff - GPU Infrastructure
Member of Technical Staff - GPU Infrastructure

Prime Intellect, Inc. • San Francisco (CA)

On-site
USD 150,000 - 300,000
Equity incentives
Infrastructure Engineer, Perimeter Compute
Infrastructure Engineer, Perimeter Compute

Montauk Capital • New York (NY)

On-site
USD 120,000 - 160,000
Competitive compensation
Equity options
Studio support from Montauk Capital
AI Compute Domain Architect — NVIDIA GPU Infra Lead
AI Compute Domain Architect — NVIDIA GPU Infra Lead

World Wide Technology • Maryland Heights (MO)

On-site
USD 110,000 - 150,000
Health and Wellness
401k with matching
Paid time off
+2