Distributed Systems Engineer for Scalable AI Platform

Fal; San Francisco (CA); On-site; USD 180,000 - 250,000; Full time

Benefits offered by this job

Remote work options for senior levels

Visa sponsorship and relocation

Health, dental, and vision insurance

Equity and competitive salary

Job summary

fal in San Francisco is seeking an experienced Software Engineer, Distributed Systems to build large-scale platform components in Python or Rust. You will own request routing, AI workload orchestration, scheduling, and GPU autoscaling for a rapidly growing service serving millions of users.

This full-time in-person role offers compelling compensation and visa sponsorship, with remote options considered for Senior and Staff levels.

Qualifications

• 3+ years experience building distributed compute and orchestration platforms in Python or Rust.
• Strong understanding of distributed systems fundamentals: consensus, scheduling, fault tolerance, capacity planning.
• Deep understanding of computational complexity and memory allocation.
• Track record of designing systems that scale under real production load.
• Experience building and using observability to drive performance and reliability decisions.
• Excellent communication and ability to drive technical decisions across teams.
• Self‑starter who executes quickly, takes ownership, and constantly seeks improvement.

Responsibilities

• Build our core Python/Rust platform: request routing, AI workload orchestration, scheduling, GPU autoscaling, large‑scale file storage, queueing, etc.
• Produce forward designs for platform evolution as we scale to 100x current traffic and need to provide low latency across the world.
• Leverage AI to an extreme level to automate the mundane parts of building complex but reliable systems.
• Profile and tune low‑level CPU and memory performance.

Skills

Distributed systems

Python

Rust

Observability

Communication

Ownership

Tools

Async runtimes

Zero-copy

Memory-safe concurrency

Job description

fal in San Francisco is seeking an experienced Software Engineer, Distributed Systems to build large-scale platform components in Python or Rust. You will own request routing, AI workload orchestration, scheduling, and GPU autoscaling for a rapidly growing service serving millions of users.

This full-time in-person role offers compelling compensation and visa sponsorship, with remote options considered for Senior and Staff levels.