Lead Fleet Operations Engineer for AI Compute Infra

Ornn AI, Inc.

New York (NY)

On-site

USD 140,000 - 230,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive salary
Meaningful equity
Health coverage
Free meals
Leadership role with equity upside

Job summary

Ornn is hiring a Fleet Operations Engineer to stand up, debug, and secure systems that get GPUs into production. You will build low-level infrastructure across Linux, from bare metal to VMs and orchestration, and manage GPU compute with Kubernetes and Slurm.

You will write production-grade Python, contribute to Rust services, and secure the node fleet with segmentation, firewalls, and access control. This leadership role offers meaningful equity and growth opportunities.

Qualifications

  • Strong low-level systems fundamentals, OS internals, performance, and debugging.
  • Excellent in Python.
  • Deep familiarity with Linux environments.
  • Effective communicator and independent problem solver.
  • Interest in AI hardware: GPUs and accelerators.

Responsibilities

  • Build and operate low‑level systems infrastructure across Linux environments, from bare metal to VMs to orchestration.
  • Provision and manage virtualized GPU compute (KVM/QEMU, GPU passthrough) alongside Kubernetes and Slurm workloads.
  • Write production-grade Python daily and contribute to Rust services.
  • Secure the node fleet with network segmentation, firewalls, access control, and secure-by-default configuration.
  • Own problems end to end in a fast-paced environment with minimal hand-holding.

Skills

Low‑level systems
Python
Linux
Communication
Problem solving
AI hardware

Tools

KVM/QEMU
Hypervisors
VM lifecycle
VPNs
Zero-trust
Firewalls

Job description

Ornn is hiring a Fleet Operations Engineer to stand up, debug, and secure systems that get GPUs into production. You will build low-level infrastructure across Linux, from bare metal to VMs and orchestration, and manage GPU compute with Kubernetes and Slurm.

You will write production-grade Python, contribute to Rust services, and secure the node fleet with segmentation, firewalls, and access control. This leadership role offers meaningful equity and growth opportunities.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Fleet Operations Engineer - AI Compute Infra
Lead Fleet Operations Engineer - AI Compute Infra

Ornn AI, Inc. • New York (NY), Northern (KY)

Hybrid
USD 140,000 - 210,000
Health coverage
Equity
Free meals
+1
Fleet Operations Engineer
Fleet Operations Engineer

Ornn AI, Inc. • New York (NY)

On-site
USD 140,000 - 230,000
Competitive salary
Meaningful equity
Health coverage
+2
Senior Compute Infra Engineer: GPU Clusters & Datacenters
Senior Compute Infra Engineer: GPU Clusters & Datacenters

Ornn AI, Inc. • New York (NY)

On-site
USD 150,000 - 230,000
Competitive salary
Meaningful equity
Health coverage
+1
Software Engineer, Fleet Orchestration
Software Engineer, Fleet Orchestration

OpenAI • New York (NY)

Hybrid
USD 180,000 - 240,000
GPU Fleet Infra Engineer — Scale, Automation & Kubernetes
GPU Fleet Infra Engineer — Scale, Automation & Kubernetes

OpenAI • New York (NY)

Hybrid
USD 180,000 - 240,000
Relocation assistance
Hybrid work model
Lead Platform Engineer - FinTech Compute
Lead Platform Engineer - FinTech Compute

Ornn AI, Inc. • New York (NY)

On-site
USD 150,000 - 210,000
Equity upside
Health coverage
Free meals
+1
Senior Engineer, Infrastructure Services
Senior Engineer, Infrastructure Services

Ornn AI, Inc. • New York (NY)

On-site
USD 150,000 - 230,000
Competitive salary
Meaningful equity
Health coverage
+1
Software Engineer, Fleet Orchestration & Systems (Hybrid)
Software Engineer, Fleet Orchestration & Systems (Hybrid)

Alfie • San Francisco (CA)

On-site
USD 230,000 - 490,000
Relocation assistance
Hybrid work model (3 days in office)
Principal AI Infrastructure Engineer — GPU Fleet
Principal AI Infrastructure Engineer — GPU Fleet

Nscale • Bellevue (WA)

On-site
USD 240,000 - 400,000
Medical, dental, vision
Flexible paid time off
Parental leave
+1
GPU Fleet Automation Engineer (Equity)
GPU Fleet Automation Engineer (Equity)

Together Computer Inc • San Francisco (CA)

On-site
USD 190,000 - 270,000
Health insurance
Equity
Competitive benefits