GPU HPC Infrastructure Engineer | Scale & Automation

OpenAI

New York (NY)

On-site

USD 150,000 - 210,000

Full time

5 days ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

OpenAI is seeking a Software Engineer for the Fleet High Performance Computing (HPC) team in New York to ensure reliability and uptime for OpenAI's compute fleet and data centers. You will build automation, monitor health, and optimize lifecycle events across clusters and hardware.

You will collaborate with networking and infra teams, develop tooling in Python/Go, and push for scalable solutions that reduce manual work while improving performance and reliability in a demanding HPC environment.

Qualifications

  • Experience building and operating large-scale server environments.
  • Strong Python/Go skills and ability to diagnose complex systems.
  • Solid knowledge of Linux, networking, and hardware fundamentals.

Responsibilities

  • Build and maintain automation systems for provisioning and managing server fleets.
  • Develop tools to monitor server health, performance, and lifecycle events.
  • Collaborate with clusters, networking, and infrastructure teams.
  • Partner with external operators to ensure a high level of quality.
  • Identify and fix performance bottlenecks and inefficiencies.
  • Continuously improve automation to reduce manual work.

Skills

Python
Go
Linux
Networking
SQL
PromQL
Pandas

Tools

Prometheus
Grafana

Job description

OpenAI is seeking a Software Engineer for the Fleet High Performance Computing (HPC) team in New York to ensure reliability and uptime for OpenAI's compute fleet and data centers. You will build automation, monitor health, and optimize lifecycle events across clusters and hardware.

You will collaborate with networking and infra teams, develop tooling in Python/Go, and push for scalable solutions that reduce manual work while improving performance and reliability in a demanding HPC environment.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Infra Software Engineer, Fleet & Automation for AI/HPC
Infra Software Engineer, Fleet & Automation for AI/HPC

Nscale • New York (NY)

On-site
USD 150,000 - 215,000
Equity
Medical insurance
Dental insurance
+4
Fleet & Automation Infrastructure Engineer — AI/HPC
Fleet & Automation Infrastructure Engineer — AI/HPC

Nscale • Houston (TX)

On-site
USD 150,000 - 215,000
Base salary + equity
Annual reviews
Growth opportunities
Software Engineer, GPU Infrastructure - HPC
Software Engineer, GPU Infrastructure - HPC

OpenAI • New York (NY)

On-site
USD 150,000 - 210,000
Senior AI Infrastructure Engineer — Scale GPU Clusters Remote
Senior AI Infrastructure Engineer — Scale GPU Clusters Remote

AI Breaking Wire • San Francisco (CA), Northern (KY)

Hybrid
USD 280,000 - 420,000
Equity options
Health, vision, dental benefits
Unlimited PTO
+2
AI Infrastructure & Automation Engineer
AI Infrastructure & Automation Engineer

Nscale • New York (NY)

On-site
USD 140,000 - 210,000
Competitive package
Equity
Growth opportunities
Software Engineer, GPU Infrastructure - HPC
Software Engineer, GPU Infrastructure - HPC

OpenAI • San Francisco (CA)

On-site
USD 325,000 - 590,000
Senior AI Infrastructure Engineer — Scale GPU Clusters
Senior AI Infrastructure Engineer — Scale GPU Clusters

AI Breaking Wire • San Francisco (CA)

On-site
USD 280,000 - 400,000
Equity
Medical, dental, and vision benefits
Unlimited PTO
+2
GPU Fleet Infra Engineer — Scale, Automation & Kubernetes
GPU Fleet Infra Engineer — Scale, Automation & Kubernetes

OpenAI • New York (NY)

Hybrid
USD 180,000 - 240,000
Relocation assistance
Hybrid work model
Fleet Automation Engineer – HPC Infrastructure
Fleet Automation Engineer – HPC Infrastructure

NorthMark Strategies LLC • Dallas (TX), Northern (KY)

Hybrid
USD 120,000 - 180,000
Lunch stipend
Medical benefits (HDHP)
401(k) match
Software Engineer, Fleet Infrastructure
Software Engineer, Fleet Infrastructure

OpenAI • New York (NY)

Hybrid
USD 180,000 - 240,000
Relocation assistance
Hybrid work model