Senior AI Infra Engineer: High-Perf Kubernetes & GPUs

Fal.ai Inc.; Northern (KY); Hybrid; USD 110,000 - 150,000; Full time

Job summary

fal is seeking an experienced infrastructure engineer to build and operate high-performance compute environments. You will manage bare-metal servers, GPU passthrough, Kubernetes, Slurm clusters, distributed storage, and high-speed networking to deliver reliable, scalable infrastructure for customers.

You will design Linux images, provisioning workflows, and automation, while collaborating with customers and internal teams to translate workloads into efficient infrastructure designs.

Qualifications

• 5+ years of experience building and operating production Linux infrastructure.
• Strong production experience with Kubernetes on bare metal (bootstrapping, upgrades, HA control planes, etcd, containerd, CNI, CSI, ingress, load-balancing, observability, security, troubleshooting).
• Experience with Linux virtualization: KVM/QEMU, libvirt, VFIO device passthrough.
• Experience operating NVIDIA GPUs on Linux and Kubernetes (drivers, container runtimes, device plugins, GPU Operator, GPU telemetry).
• Strong networking fundamentals: TCP/IP, L2/L3, VLANs, routing, packet-level troubleshooting (tcpdump, Wireshark).
• Practical scripting experience.
• Experience with configuration-management tools such as Ansible.
• Ability to diagnose complex, cross-layer infrastructure issues.
• Strong communication and ability to drive technical decisions across teams.
• Track record of moving quickly, taking ownership, and continuously improving systems.

Responsibilities

• Design, automate, validate, and deliver the complete lifecycle of customer compute environments — from provisioning through upgrades, recovery, and decommissioning
• Use AI aggressively to automate and accelerate every aspect of infrastructure delivery and operations
• Provision dedicated Kubernetes and Slurm clusters tailored to customer workloads
• Build and maintain Linux images and automated OS-provisioning workflows
• Operate the NVIDIA GPU stack: drivers, GPU Operator, NVIDIA Container Toolkit, device plugins, MIG, and GPU monitoring
• Design Kubernetes and data-center networking using Cilium/Calico, MetalLB, VLAN, VXLAN, BGP, and ECMP
• Configure distributed and shared storage for high-performance workloads
• Build monitoring, alerting, diagnostics, and automated recovery for customer environments
• Develop reusable tooling, standards, documentation, and runbooks
• Collaborate with customers and internal teams to translate workload requirements into sound infrastructure designs

Skills

Kubernetes

Linux administration

NVIDIA GPUs

Networking fundamentals

Scripting

Configuration management

Cross-team communication

Tools

KVM/QEMU

libvirt

VFIO passthrough

Ansible

Cilium/Calico

MetalLB

Docker/containerd

Ceph

Lustre

KubeVirt

OpenStack

Job description

fal is seeking an experienced infrastructure engineer to build and operate high-performance compute environments. You will manage bare-metal servers, GPU passthrough, Kubernetes, Slurm clusters, distributed storage, and high-speed networking to deliver reliable, scalable infrastructure for customers.

You will design Linux images, provisioning workflows, and automation, while collaborating with customers and internal teams to translate workloads into efficient infrastructure designs.