Software Engineer, Site Reliability

Fal; San Francisco (CA); On-site; USD 180,000 - 250,000; Full time

Benefits offered by this job

Relocation assistance to San Francisco

Visa sponsorship

Competitive salary and equity

Health, dental, and vision insurance (

Job summary

fal is seeking a Software Engineer, Site Reliability in San Francisco. You will keep production infrastructure running at scale, owning the reliability of customer-facing systems—from Kubernetes clusters to deployment pipelines and the networking layer that connects it all.

You think in SLOs, automate ruthlessly, and treat every incident as a chance to improve the system. This is a full-time, onsite role with potential remote flexibility for senior levels.

Qualifications

• 5+ years experience managing production systems and software development workflows.
• Strong production experience setting up and operating Kubernetes at scale using IaC tools.
• Deep knowledge of Linux networking, container networking, DNS.
• Experience building CI/CD systems and GitOps workflows (FluxCD, ArgoCD).
• Proficiency in Python and Go or Bash for tooling and automation.

Responsibilities

• Own and operate our Kubernetes infrastructure: cluster lifecycle, upgrades, networking, and multi-tenant isolation for customer workloads.
• Build and maintain CI/CD pipelines and deployment infrastructure.
• Leverage AI to automate analysis and resolution of production issues, improving speed, reliability and maintainability.
• Build dashboards, alerting, and anomaly detection across systems.
• Define and enforce SLOs and build incident response processes.
• Manage and improve networking, load balancing, and service mesh configurations.
• Drive reliability improvements across the stack through automation, runbooks, and chaos engineering.

Skills

Kubernetes

CI/CD

Python

Go

Bash

Linux networking

Terraform

Ansible

Prometheus

Grafana

Loki

Datadog

Tools

FluxCD

ArgoCD

Terraform

Ansible

Job description

Software Engineer, Site Reliability

Hi there! We are fal, a company building the world’s first generative media platform for developers.

We built a serverless runtime for Python that is optimized to run large ML models on thousands of GPUs efficiently. Our platform serves millions of users worldwide, and our goal is to 1000x that over the next few years.

fal is an in‑person company based in San Francisco, with a core team of 80 people. We’re looking for talented engineers who can build world‑class infrastructure and thrive in the fast‑moving world of AI.

Employment Type

Full time

Location

San Francisco, CA (remote for Senior and Staff levels)

About this role

You are a seasoned SRE who keeps production infrastructure running at scale. You own the reliability and availability of customer‑facing systems — from Kubernetes clusters to deployment pipelines to the networking layer that connects it all. You think in SLOs, automate ruthlessly, and treat every incident as a chance to make the system better.

Key Responsibilities

• Own and operate our Kubernetes infrastructure: cluster lifecycle, upgrades, networking, and multi‑tenant isolation for customer workloads
• Build and maintain CI/CD pipelines and deployment infrastructure
• Leverage AI to an extreme level to automate analysis and resolution of production issues, and improve software development speed, reliability and maintainability
• Build dashboards, alerting, and anomaly detection across our systems
• Define and enforce SLOs and build out incident response processes
• Manage and improve our networking, load balancing, and service mesh configurations
• Drive reliability improvements across the stack through automation, runbooks, and chaos engineering

Requirements

• 5+ years experience in managing critical production systems and software development workflows
• Strong production experience setting up and operating Kubernetes at scale, using infrastructure-as-code (Terraform, Ansible)
• Deep knowledge of Linux networking, container networking (CNI plugins, VXLAN, BGP), and DNS
• Experience building CI/CD systems and GitOps workflows (FluxCD, ArgoCD)
• Proficiency in Python and either Go or Bash for tooling and automation
• Strong experience with logging, monitoring and alerting (Prometheus, Grafana, Loki, Thanos, VictoriaMetrics, Datadog)
• Excellent communication and ability to drive technical decisions across teams
• Self‑starter who executes quickly, takes ownership, and constantly seeks improvement

Nice to have

• Experience with managing GPU and AI/ML workloads
• Experience with kernel‑based monitoring and routing (eBPF, XDP)
• Experience with security tooling (Falco, Coroot, SIEM)
• Experience with bare metal Kubernetes networking (Calico, Cilium, MetalLB)
• Experience with distributed storage systems (Ceph, Longhorn, etc.)

Compensation

$180,000-250,000 plus equity + benefits (range is based across 3 levels: Mid, Senior and Staff)

What we offer at fal

• Interesting and challenging work
• Learning and growth opportunities
• Regular team events and offsites
• Health, dental, and vision insurance (US)
• Relocation assistance to San Francisco
• Visa sponsorship (for eligible candidates)
• Competitive salary and equity