Platform Software Engineer—AI Infra for GPU Fleet

fal - Features & Labels; United States; Remote; USD 150,000 - 210,000; Full time

Benefits offered by this job

Interesting and challenging work

Learning and growth opportunities

Visa sponsorship and relocation to San

Job summary

fal - Features & Labels is seeking a hands-on engineer to manage a large pool of GPU servers. You will build Python-based fleet tooling, automate provisioning and health checks, and create dashboards for hardware health across thousands of servers.

You’ll harden OS security and optimize storage and GPU driver stacks, collaborating with partners to resolve complex infra issues. The role requires strong Python software engineering, deep Linux knowledge, and IaC experience.

Qualifications

• 3+ years experience managing bare-metal and cloud based server fleets at scale (100+ nodes).
• Strong software engineering skills in Python; production tooling mindset.
• Deep Linux systems knowledge: boot process, kernel tuning, networking, storage, systemd.
• IaC experience with Ansible, Terraform, cloud-init.
• Solid understanding of storage technologies and hardware diagnostics.
• Experience building internal tools or dashboards for infrastructure visibility.
• Excellent communication and ability to drive technical decisions across teams.
• Self-starter who executes quickly, takes ownership and seeks improvement.

Responsibilities

• Build and maintain Python fleet tracking system managing server lifecycles, pricing, availability, and RMAs.
• Develop server management tooling for provisioning, health checks, GPU diagnostics, recovery and alerting.
• Create and maintain metrics, dashboards, and alerting for hardware health across the fleet.
• Leverage AI to automate alerting and recovery at scale.
• Implement OS security baselines, SELinux/AppArmor, SSH key management, vulnerability scanning.
• Manage distributed storage for model weights, checkpoints, and scratch space.
• Tune Linux systems for AI workloads including kernel parameters and GPU driver stack.
• Develop automated error detection and recovery processes and collaborate with partners.

Skills

Python

Linux systems

Communication

Self-starter

InfrastructureAutomation

Tooling development

Troubleshooting hardware

System performance

Tools

Ansible

Terraform

cloud-init

NVIDIA DCGM

libvirt/QEMU

Job description

fal - Features & Labels is seeking a hands-on engineer to manage a large pool of GPU servers. You will build Python-based fleet tooling, automate provisioning and health checks, and create dashboards for hardware health across thousands of servers.

You’ll harden OS security and optimize storage and GPU driver stacks, collaborating with partners to resolve complex infra issues. The role requires strong Python software engineering, deep Linux knowledge, and IaC experience.