Head of GPU Infrastructure & HPC Engineering

Greylock Partners

New York (NY)

On-site

USD 210,000 - 320,000

Full time

9 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Greylock Partners-backed startup in New York is seeking a Head of Engineering to own the GPU infrastructure and HPC platform powering cloud simulation for robotics and AI. You will lead engineering across cloud infrastructure, backend, frontend, and developer-experience, writing substantial production code and guiding the team in a fast-growing environment.

The role requires hands-on leadership to optimize GPU scheduling, data pipelines, and compute costs while maintaining reliability.

Qualifications

  • 5+ years building software and leading engineering teams at fast-growing companies.
  • Experience operating GPU-accelerated cloud systems at scale.
  • Deep experience with distributed systems, MLOps, Kubernetes, data pipelines, and compute scheduling tools such as Ray or Slurm.
  • Proficiency writing production-grade Python and making cost-conscious engineering decisions.

Responsibilities

  • Set technical direction and own the core platform powering GPU infrastructure.
  • Lead GPU scheduling across multiple compute pools and cloud providers.
  • Oversee distributed job execution, data pipelines, storage, and reproducible workflows.
  • Hire and develop engineers to own systems end-to-end and maintain strong engineering practices.

Skills

Python
Distributed systems
GPU scheduling
MLOps
Leadership
Documentation & code reviews

Tools

Kubernetes
Ray
Slurm

Job description

Greylock Partners-backed startup in New York is seeking a Head of Engineering to own the GPU infrastructure and HPC platform powering cloud simulation for robotics and AI. You will lead engineering across cloud infrastructure, backend, frontend, and developer-experience, writing substantial production code and guiding the team in a fast-growing environment.

The role requires hands-on leadership to optimize GPU scheduling, data pipelines, and compute costs while maintaining reliability.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Head of Engineering (GPU Infrastructure / HPC)
Head of Engineering (GPU Infrastructure / HPC)

Greylock Partners • New York (NY)

On-site
USD 210,000 - 320,000
Director of Engineering, GPU Cloud Platform
Director of Engineering, GPU Cloud Platform

Antioch • New York (NY)

On-site
USD 200,000 - 260,000
Head of GPU Cloud
Head of GPU Cloud

Blue Signal LLC. • United States

On-site
USD 250,000 - 350,000
Senior GPU Cloud Infrastructure Engineer
Senior GPU Cloud Infrastructure Engineer

Hyperbolic • San Francisco (CA)

On-site
USD 180,000 - 240,000
Head of GPU Systems Engineering
Head of GPU Systems Engineering

Blue Signal Search • Fremont (CA)

On-site
USD 180,000 - 260,000
Senior GPU Infrastructure Architect for Multi-Tenant Cloud
Senior GPU Infrastructure Architect for Multi-Tenant Cloud

Devopsroles • San Francisco (CA)

Remote
USD 180,000 - 240,000
Senior GPU Systems Engineer: Scale AI Clusters & HPC
Senior GPU Systems Engineer: Scale AI Clusters & HPC

Career Techniques • New York (NY)

Hybrid
USD 200,000 - 300,000
Head of GPU & AI Data Center Operations
Head of GPU & AI Data Center Operations

Programming.com • United States

On-site
USD 180,000 - 280,000
Senior Backend Engineer - GPU Cloud Platform
Senior Backend Engineer - GPU Cloud Platform

Lightning AI • San Francisco (CA), Seattle (WA), New York (NY)

Hybrid
USD 180,000 - 250,000
Comprehensive Health Coverage
Meaningful Equity
401(k) matching
+3
Compute Platform Lead | Frontier AI Research Lab - New York, SF or London
Compute Platform Lead | Frontier AI Research Lab - New York, SF or London

Oscar Faye • New York (NY)

On-site
USD 250,000 - 360,000
Health cover
Parental leave
Flexible time off
+2