Senior/Staff Software Engineer, Kubernetes Infrastructure

Kindredventures

United States

On-site

USD 140,000 - 190,000

Full time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Kindredventures is hiring a senior Linux infrastructure engineer to design and run high-performance compute environments. You will manage bare-metal Kubernetes clusters, NVIDIA GPU stacks, and Slurm workflows, delivering scalable, reliable workloads for demanding AI/ML tasks.

You will automate provisioning, upgrades and recovery across Linux images, networking, and storage while collaborating with customers and cross-functional teams to translate workload requirements into robust designs.

Qualifications

  • 5+ years building and operating production Linux infrastructure.
  • Experience with Kubernetes on bare metal including upgrades and HA control planes.
  • Strong networking fundamentals and practical scripting skills.
  • Experience with NVIDIA GPUs on Linux/Kubernetes and related tooling.
  • Ability to diagnose cross-layer infrastructure issues and drive decisions.

Responsibilities

  • Design and automate complete lifecycle of customer compute environments.
  • Automate provisioning upgrades recovery and decommissioning processes.
  • Manage Linux images OS provisioning and cluster networking.
  • Operate NVIDIA GPU stack and related components.
  • Develop reusable tooling and runbooks for operations.

Skills

Linux administration
Kubernetes
Bare metal
NVIDIA GPU stack
Networking fundamentals
Scripting
Ansible
VMware / virtualization
Troubleshooting
Observability

Education

Bachelor's or equivalent in CS/engineering

Tools

Kubernetes on bare metal
Slurm
NVIDIA GPU drivers & toolkit
Linux virtualization (KVM/QEMU)
NetBox / Nornir (network automation)
Ansible

Job description

fal is the generative media ecosystem powering the next generation of AI products. We build the infrastructure, tools, and model access that teams need to move from idea to production, and do it at scale without compromise. For developers and enterprises, fal is the foundation that makes generative media not just possible, but practical: a unified platform where high-performance inference, orchestration, and observability come together to unlock new categories of AI-native products.

As generative media reshapes industries across a market projected to grow by hundreds of billions over the next decade, fal is becoming the ecosystem that ambitious teams build on.

You will build the high-performance compute environments we deliver to customers. These environments span bare-metal servers, virtual machines with GPU passthrough, Kubernetes and Slurm clusters, distributed storage, and high-speed networking.

You will work across the infrastructure stack — from Linux images and hardware provisioning to cluster networking, GPU performance, observability, and lifecycle automation. The goal is to make every customer environment performant, reliable, isolated, and repeatable.

Key Responsibilities:
  • Design, automate, validate, and deliver the complete lifecycle of customer compute environments — from provisioning through upgrades, recovery, and decommissioning

  • Use AI aggressively to automate and accelerate every aspect of infrastructure delivery and operations

  • Provision dedicated Kubernetes and Slurm clusters tailored to customer workloads

  • Build and maintain Linux images and automated OS-provisioning workflows

  • Operate the NVIDIA GPU stack: drivers, GPU Operator, NVIDIA Container Toolkit, device plugins, MIG, and GPU monitoring

  • Design Kubernetes and data-center networking using Cilium/Calico, MetalLB, VLAN, VXLAN, BGP, and ECMP

  • Configure distributed and shared storage for high-performance workloads

  • Build monitoring, alerting, diagnostics, and automated recovery for customer environments

  • Develop reusable tooling, standards, documentation, and runbooks

  • Collaborate with customers and internal teams to translate workload requirements into sound infrastructure designs

Requirements:
  • 5+ years of experience building and operating production Linux infrastructure

  • Strong production experience with Kubernetes on bare metal (bootstrapping, upgrades, HA control planes, etcd, containerd, CNI, CSI, ingress, load-balancing, observability, security, troubleshooting)

  • Experience with Linux virtualization: KVM/QEMU, libvirt, VFIO device passthrough

  • Experience operating NVIDIA GPUs on Linux and Kubernetes (drivers, container runtimes, device plugins, GPU Operator, GPU telemetry)

  • Strong networking fundamentals: TCP/IP, L2/L3, VLANs, routing, packet-level troubleshooting (tcpdump, Wireshark)

  • Practical scripting experience

  • Experience with configuration-management tools such as Ansible

  • Ability to diagnose complex, cross-layer infrastructure issues

  • Strong communication and ability to drive technical decisions across teams

  • Track record of moving quickly, taking ownership, and continuously improving systems

Nice to Have:
  • Production Slurm experience

  • High-performance networking: NVLink/NVSwitch, InfiniBand, RoCEv2, GPUDirect RDMA, NCCL, IMEX

  • Hugepages, NUMA, CPU pinning

  • SR-IOV, DPDK

  • Distributed storage: Ceph, Lustre, Weka

  • KubeVirt, OpenStack

  • IPsec, WireGuard, Tailscale

  • VXLAN, BGP, ECMP

  • Bare-metal management: BMC, IPMI, Redfish, PXE/iPXE, Kickstart, cloud-init

  • Network automation: NetBox, Nautobot, Nornir

  • AI training, inference, or distributed GPU workload infrastructure

  • Python or Go proficiency

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Cluster Engineer
Cluster Engineer

STN Inc • San Francisco (CA)

On-site
USD 180,000 - 240,000
Member of Technical Staff – Software Engineer, GPU Cluster Infrastructure
Member of Technical Staff – Software Engineer, GPU Cluster Infrastructure

Perplexity • San Francisco (CA)

On-site
USD 180,000 - 240,000
Senior Solutions Engineer, AI Infrastructure
Senior Solutions Engineer, AI Infrastructure

VAST Data • New York (NY)

On-site
USD 150,000 - 200,000
AI Infra Engineer – SRE (Kubernetes)
AI Infra Engineer – SRE (Kubernetes)

Berrybytes • United States

On-site
USD 110,000 - 150,000
SRE / Platform Engineer, GPU Infrastructure
SRE / Platform Engineer, GPU Infrastructure

Bake AI • Hillsboro (OR)

On-site
USD 140,000 - 210,000
Senior Software Engineer, Infrastructure Software for AI (Centralized AI Data Centers & Distrib[...]
Senior Software Engineer, Infrastructure Software for AI (Centralized AI Data Centers & Distrib[...]

Intelliswift - An LTTS Company • Sunnyvale (CA)

On-site
USD 120,000 - 150,000
Competitive salary
Health insurance
Flexible work hours
Senior/Staff Software Engineer, Network Infrastructure
Senior/Staff Software Engineer, Network Infrastructure

Kindredventures • United States

On-site
USD 180,000 - 240,000
Principal Infrastructure Engineer, AI Cluster Performance & Validation
Principal Infrastructure Engineer, AI Cluster Performance & Validation

Socket.dev • Houston (TX)

On-site
USD 200,000 - 260,000
Senior Kubernetes Engineer
Senior Kubernetes Engineer

GTN Technical Staffing • Dallas (TX)

On-site
USD 140,000 - 200,000
Principal Infrastructure Engineer, AI Cluster Performance & Validation
Principal Infrastructure Engineer, AI Cluster Performance & Validation

Nscale • New York (NY), San Francisco (CA), Seattle (WA)

On-site
USD 180,000 - 240,000