GenAI Backend Engineer: HTTP Proxies & Scale

Speedrun Talent Network

San Francisco (CA)

On-site

USD 120,000 - 190,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health, dental, and vision insurance (

Job summary

fal is building the generative media infrastructure powering AI products with scalable HTTP proxies, model access, and observability. We provide the foundations teams need to move from idea to production, at scale and without compromise.

As GenAI reshapes industries, fal is the ecosystem ambitious teams rely on. This role focuses on high-performance backend APIs, serverless endpoints, and reliable proxies to partner model providers.

Qualifications

  • 3+ years of demonstrated experience in building HTTP services with Python.
  • Experience designing, analyzing and improving efficiency, scalability, and stability of various system resources.
  • Proficiency in version control practices and CI/CD pipelines.

Responsibilities

  • Identify, design, and develop foundational HTTP proxies and fal serverless endpoints for 3rd party model providers.
  • Write clear, well-tested, and maintainable software.
  • Analyze and improve the robustness and scalability of existing proxies, APIs and fallback infrastructure.
  • Conduct design and code reviews, create developer documentation, and develop testing strategies for robustness and fault tolerance.

Skills

Python
Backend APIs
CI/CD
Code reviews

Tools

Git

Job description

fal is building the generative media infrastructure powering AI products with scalable HTTP proxies, model access, and observability. We provide the foundations teams need to move from idea to production, at scale and without compromise.

As GenAI reshapes industries, fal is the ecosystem ambitious teams rely on. This role focuses on high-performance backend APIs, serverless endpoints, and reliable proxies to partner model providers.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GenAI Backend Engineer — ML Proxies & AI APIs
GenAI Backend Engineer — ML Proxies & AI APIs

fal • San Francisco (CA)

On-site
USD 120,000 - 180,000
Interesting and challenging work
Learning and growth opportunities
Health, dental, and vision insurance (
+1
Software Engineer, Machine Learning-Backend
Software Engineer, Machine Learning-Backend

fal • San Francisco (CA)

On-site
USD 120,000 - 180,000
Interesting and challenging work
Learning and growth opportunities
Health, dental, and vision insurance (
+1
Software Engineer, Machine Learning-Backend
Software Engineer, Machine Learning-Backend

Speedrun Talent Network • San Francisco (CA)

On-site
USD 120,000 - 190,000
Health, dental, and vision insurance (
GenAI Platform Engineer: Scale Generative AI APIs
GenAI Platform Engineer: Scale Generative AI APIs

AMS Accelerate IT • United States

Remote
USD 130,000 - 185,000
Senior Network Infrastructure Engineer: Scale & Performance
Senior Network Infrastructure Engineer: Scale & Performance

Kindredventures • United States

On-site
USD 180,000 - 240,000
Senior Backend Architect GenAI Scale (Remote)
Senior Backend Architect GenAI Scale (Remote)

Vyro • United States

Remote
USD 140,000 - 190,000
Fully remote
GenAI Backend Engineer — Scale Production AI Apps
GenAI Backend Engineer — Scale Production AI Apps

BayOne Solutions • Waltham (MA)

On-site
USD 130,000 - 170,000
Senior Backend Engineer - AI Inference Platform
Senior Backend Engineer - AI Inference Platform

Mixpeek • San Francisco (CA)

Remote
USD 200,000 - 250,000
Office hubs SF/NYC
Flexible PTO
Health insurance
+7
GenAI Engineer: Build AI Agents & RLHF at Scale
GenAI Engineer: Build AI Agents & RLHF at Scale

impact.com • Capetown (CA)

On-site
USD 120,000 - 170,000
Unlimited PTO
Training & Development
Stock Options
+3
Remote GenAI Backend Engineer (Python & Cloud)
Remote GenAI Backend Engineer (Python & Cloud)

Provenir • New York (NY)

On-site
USD 120,000 - 170,000
Health benefits
PTO & holidays
Remote-friendly
+1