Staff Engineer, AI Infrastructure & Fleet Automation

Creandum

San Francisco (CA)

On-site

USD 180,000 - 280,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Modal is building a new infrastructure layer for AI workloads. We are seeking engineers to design, build, and maintain the high-performance systems for our serverless platform, focusing on the fleet of bare-metal and cloud hosts that run all Functions, Sandboxes, and training jobs.

You will automate integration, imaging, monitoring, and repairs, and ensure the fleet runs with minimal human intervention. Strong cloud and OS fundamentals are essential, as is willingness to handle production

Qualifications

  • 5+ years of experience writing high-quality production code.
  • Experience operating fleets of physical hardware (bare-metal provisioning, BMC/IPMI, PXE) or building control planes.
  • Strong cloud skills and knowledge of modern cloud infrastructure.

Responsibilities

  • Automate remediation and health checks for hardware fleets to maximize uptime.
  • Integrate new CPU/GPU/storage servers into the fleet while handling hardware heterogeneity.
  • Monitor datacenter network health across multiple sites and standardize bare-metal config.
  • Lead hardware acceptance testing and benchmarking (CPU, disk, GPU, interconnect, network).
  • Build and maintain the machine image pipeline, bootloader, and firmware management.

Skills

Production coding
Cloud platforms
Linux internals
Debugging across layers
On-call readiness

Tools

Go
NVIDIA software stack

Job description

Modal is building a new infrastructure layer for AI workloads. We are seeking engineers to design, build, and maintain the high-performance systems for our serverless platform, focusing on the fleet of bare-metal and cloud hosts that run all Functions, Sandboxes, and training jobs.

You will automate integration, imaging, monitoring, and repairs, and ensure the fleet runs with minimal human intervention. Strong cloud and OS fundamentals are essential, as is willingness to handle production

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Infrastructure Engineer — Customer-Facing & Cloud
AI Infrastructure Engineer — Customer-Facing & Cloud

FDE Times • Town of Tonawanda (NY)

On-site
USD 180,000 - 280,000
Staff Engineer, Bare-Metal & GPU Infrastructure
Staff Engineer, Bare-Metal & GPU Infrastructure

Mixpeek • San Francisco (CA)

On-site
USD 180,000 - 240,000
Member of Technical Staff - Machines
Member of Technical Staff - Machines

Mixpeek • San Francisco (CA)

On-site
USD 180,000 - 240,000
Member of Technical Staff - Machines
Member of Technical Staff - Machines

Creandum • San Francisco (CA)

On-site
USD 180,000 - 280,000
Staff AI Inference & Systems Engineer
Staff AI Inference & Systems Engineer

Mixpeek • San Francisco (CA)

On-site
USD 180,000 - 240,000
Software Engineer, Fleet Orchestration & Systems (Hybrid)
Software Engineer, Fleet Orchestration & Systems (Hybrid)

Alfie • San Francisco (CA)

On-site
USD 230,000 - 490,000
Relocation assistance
Hybrid work model (3 days in office)
Software Engineer, Fleet Orchestration
Software Engineer, Fleet Orchestration

OpenAI • New York (NY)

Hybrid
USD 180,000 - 240,000
Member of Technical Staff - Platform Engineering
Member of Technical Staff - Platform Engineering

Modal • New York (NY)

On-site
USD 150,000 - 190,000
Production Systems Engineer — Fleet AI Hardware & Automation
Production Systems Engineer — Fleet AI Hardware & Automation

Meta • Bellevue (WA)

Hybrid
USD 140,000 - 190,000
AI Infrastructure Engineer — Real-Time Fleet Health
AI Infrastructure Engineer — Real-Time Fleet Health

Fluidstack • New York (NY)

On-site
USD 180,000 - 260,000
Competitive compensation
Health, dental, and vision insurance
Retirement plan
+1