Member of Technical Staff - Machines

Creandum

San Francisco (CA)

On-site

USD 180,000 - 280,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Modal is building a new infrastructure layer for AI workloads. We are seeking engineers to design, build, and maintain the high-performance systems for our serverless platform, focusing on the fleet of bare-metal and cloud hosts that run all Functions, Sandboxes, and training jobs.

You will automate integration, imaging, monitoring, and repairs, and ensure the fleet runs with minimal human intervention. Strong cloud and OS fundamentals are essential, as is willingness to handle production

Qualifications

  • 5+ years of experience writing high-quality production code.
  • Experience operating fleets of physical hardware (bare-metal provisioning, BMC/IPMI, PXE) or building control planes.
  • Strong cloud skills and knowledge of modern cloud infrastructure.

Responsibilities

  • Automate remediation and health checks for hardware fleets to maximize uptime.
  • Integrate new CPU/GPU/storage servers into the fleet while handling hardware heterogeneity.
  • Monitor datacenter network health across multiple sites and standardize bare-metal config.
  • Lead hardware acceptance testing and benchmarking (CPU, disk, GPU, interconnect, network).
  • Build and maintain the machine image pipeline, bootloader, and firmware management.

Skills

Production coding
Cloud platforms
Linux internals
Debugging across layers
On-call readiness

Tools

Go
NVIDIA software stack

Job description

About Us: AI needs a new infrastructure layer. We're building it at Modal.

Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now.

Our customers include category-defining companies like Ramp, Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale.

We've passed $1B in annualized run rate, up 15x from a year ago. In October 2026 we raised a $750M Series D led by Accel at a $15.75B valuation.

Our team includes creators of popular open-source projects (e.g., Seaborn, Luigi), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience.

The Role:

We are looking for strong engineers with experience and interest in designing, building, and maintaining the novel, high-performance systems that make up our serverless platform.

Specifically, you'll be working on Modal’s machines layer: the fleet of bare-metal and cloud hosts that every Function, Sandbox, and training job runs on, and the control plane that provisions, images, monitors, and repairs them.

You'll automate the integration of new capacity from a growing set of hardware providers, from auditing and benchmarking hosts and clusters to maintaining our machine images, configuring GPUs, RDMA, networking, and storage, and getting machines into production. You'll build the automation that keeps the fleet healthy without human intervention: detecting bad GPUs, thermals, and disks. You'll dig into whatever is between the hardware and the software that runs on top of it, whether that is a kernel panic, a broadcast storm during boot, or getting our container runtime to run on new architectures and platforms.

What You'll Work On:
  • Automate remediation of unhealthy machines (power cycling, reimaging, GPU recovery) to maximize uptime and minimize operator toil

  • Automate integration of new CPU, GPU, and storage servers into the fleet while managing hardware and network heterogeneity

  • Monitor network health and reliability across many datacenters, and standardize bare-metal network configuration

  • Automate hardware acceptance testing and benchmarking (CPU, disk, GPU, interconnect, network)

  • Build our custom network bootloader, machine image pipeline, and kernel and firmware management across the fleet

You May Be a Fit If:
  • You have 5+ years of experience writing high-quality production code

  • You've operated fleets of physical hardware (bare-metal provisioning, BMC/IPMI, PXE or network boot, firmware) or built the control planes that manage them (the more challenges you've worked through, the better)

  • You have strong cloud skills

  • You have strong knowledge of low-level operating system foundations (Linux kernel, drivers, networking, file systems, containers, etc.)

  • You’re effective at debugging across layers, from BGP flapping, Linux RPS, and vBIOS bugs to a Python control-plane service

  • You’re willing to step into the thick of it with our on-call rotation and respond to production incidents

Nice-to-Haves:
  • Experience with GPUs and the NVIDIA software stack in production (drivers, health monitoring, XIDs, RDMA/NVLink)

  • Prior experience with Go

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff - Machines
Member of Technical Staff - Machines

Mixpeek • San Francisco (CA)

On-site
USD 180,000 - 240,000
Member of Technical Staff - Platform Engineering
Member of Technical Staff - Platform Engineering

Modal • New York (NY)

On-site
USD 150,000 - 190,000
Member of Technical Staff - Storage
Member of Technical Staff - Storage

modal • Town of Stockholm (NY)

On-site
USD 180,000 - 260,000
Member of Technical Staff - Storage
Member of Technical Staff - Storage

Creandum • New York (NY)

On-site
USD 180,000 - 260,000
Staff Engineer, Bare-Metal & GPU Infrastructure
Staff Engineer, Bare-Metal & GPU Infrastructure

Mixpeek • San Francisco (CA)

On-site
USD 180,000 - 240,000
Member of Technical Staff - ML Performance
Member of Technical Staff - ML Performance

Modal Labs • New York (NY)

On-site
USD 150,000 - 190,000
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)

Perplexity • United States

Remote
USD 180,000 - 320,000
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)

Perplexity • United States

On-site
USD 180,000 - 240,000
Head of IT
Head of IT

Mixpeek • New York (NY)

On-site
USD 180,000 - 280,000
Forward Deployed Engineer - Systems
Forward Deployed Engineer - Systems

FDE Times • Town of Tonawanda (NY)

On-site
USD 180,000 - 280,000