Senior Staff Infra Engineer — AI Compute & GPU Clusters

Fal; United States; Remote; USD 180,000 - 250,000; Full time

Benefits offered by this job

Visa sponsorship

Relocation to San Francisco

Health insurance

Job summary

fal is building the high-performance compute environments for customers, spanning bare-metal servers, GPU-passthrough VMs, Kubernetes and Slurm clusters, and distributed storage. You will shape Linux images, provisioning, and cluster networking to deliver reliable, repeatable environments.

You will drive automation across provisioning, upgrades, and recovery, leveraging AI to accelerate every facet of infrastructure delivery and operations while collaborating with customers and internal teams.

Qualifications

• Experience designing and operating production Linux infrastructure.
• Proficient with Kubernetes on bare metal and container runtimes.
• Familiarity with NVIDIA GPU drivers, GPU telemetry, and GPU acceleration tooling.
• Strong networking fundamentals and distributed storage experience.

Responsibilities

• Design, automate, validate, and deliver the complete lifecycle of customer compute environments—from provisioning through upgrades, recovery, and decommissioning.
• Use AI to automate and accelerate infrastructure delivery and operations.
• Provision dedicated Kubernetes and Slurm clusters for customer workloads.
• Build and maintain Linux images and automated OS provisioning workflows.
• Operate the NVIDIA GPU stack and related tooling.
• Design Kubernetes and data-center networking and configure distributed storage for high-performance workloads.
• Build monitoring, alerting, diagnostics, and automated recovery for customer environments.
• Develop reusable tooling, standards, documentation, and runbooks.
• Collaborate with customers and internal teams to translate workload requirements into infrastructure designs.

Skills

Strong communication

Ownership

Problem solving

Team collaboration

Tools

Kubernetes

Slurm

Linux

NVIDIA GPU stack

Cilium/Calico networking

Ceph/Lustre storage

GPU Operator

Docker/Containerd

Job description

fal is building the high-performance compute environments for customers, spanning bare-metal servers, GPU-passthrough VMs, Kubernetes and Slurm clusters, and distributed storage. You will shape Linux images, provisioning, and cluster networking to deliver reliable, repeatable environments.

You will drive automation across provisioning, upgrades, and recovery, leveraging AI to accelerate every facet of infrastructure delivery and operations while collaborating with customers and internal teams.