Senior Distributed Systems Engineer - AI Infrastructure

Recruiting from Scratch LLC

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

5 days ago
Be an early applicant
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive equity package
In-person engineering culture

Job summary

Recruiting from Scratch LLC is seeking a Senior Software Engineer to own architecture and implementation of distributed systems for AI agent orchestration. You will design and operate scalable backend services in a fast-paced, in-person setting in San Francisco.

The role emphasizes technical ownership, deep debugging skills, and leadership in implementing high-throughput infrastructure for real-time agent communication.

Qualifications

  • 7+ years of professional software engineering experience.
  • Primary individual contributor on multiple medium-to-large technical projects.
  • Deep experience designing, deploying, and operating distributed services in production.
  • Strong understanding of concurrency, distributed systems, data modeling, and production infrastructure.
  • Experience solving scalability challenges with high-throughput or highly concurrent workloads.

Responsibilities

  • Design, build, deploy, and operate distributed systems supporting hundreds of thousands of concurrent AI agents.
  • Own medium-to-large engineering initiatives as a primary individual contributor from architecture through production.
  • Build infrastructure capable of processing millions of tokens per minute across highly parallel workloads.
  • Design systems handling massive numbers of agents reading from and writing to shared data models.
  • Build real-time infrastructure for transmitting agent outputs across backend services to end users.
  • Debug complex production issues spanning concurrency, distributed state, infrastructure, and application services.

Skills

Distributed systems design
Concurrency
Debugging complex systems
Technical leadership
Communication
Independent ownership

Tools

Go
Redis
PostgreSQL
S3
Temporal
Pub/Sub

Job description

Recruiting from Scratch LLC is seeking a Senior Software Engineer to own architecture and implementation of distributed systems for AI agent orchestration. You will design and operate scalable backend services in a fast-paced, in-person setting in San Francisco.

The role emphasizes technical ownership, deep debugging skills, and leadership in implementing high-throughput infrastructure for real-time agent communication.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Infrastructure Engineer for Autonomous Agents
Senior AI Infrastructure Engineer for Autonomous Agents

Engg • San Francisco (CA)

On-site
USD 150,000 - 250,000
Senior AI Agent Systems Architect
Senior AI Agent Systems Architect

hackajob • Seattle (WA)

On-site
USD 180,000 - 240,000
Health care coverage
On-site health and wellness centers
Retirement savings plan
+4
Senior AI Backend Engineer – Enterprise-Scale Orchestration
Senior AI Backend Engineer – Enterprise-Scale Orchestration

Klarity • San Francisco (CA)

On-site
USD 220,000 - 280,000
Equity
Employer-Paid Medical
Parental Leave
+4
Senior Engine & Distributed Systems Engineer
Senior Engine & Distributed Systems Engineer

Stack AI • San Francisco (CA), New York (NY)

Hybrid
USD 180,000 - 280,000
Forward Deployed AI Engineer – Agent Systems
Forward Deployed AI Engineer – Agent Systems

MaxIT Consulting - Max Corporate Group • San Francisco (CA)

On-site
USD 170,000 - 250,000
Senior Engine & Distributed Systems Engineer
Senior Engine & Distributed Systems Engineer

Stack AI, Inc. • New York (NY)

On-site
USD 120,000 - 160,000
Senior Engine & Distributed Systems Engineer
Senior Engine & Distributed Systems Engineer

StackAI • San Francisco (CA)

On-site
USD 120,000 - 160,000
Senior Software Engineer
Senior Software Engineer

Recruiting from Scratch LLC • San Francisco (CA)

On-site
USD 180,000 - 240,000
Competitive equity package
In-person engineering culture
Senior AI Agent Systems Engineer — Infra & Platform
Senior AI Agent Systems Engineer — Infra & Platform

Together • San Francisco (CA)

On-site
USD 250,000 - 300,000
Remote work flexibility
Equity
Health insurance
Senior Distributed Systems Engineer — AI Platform & Orchestration
Senior Distributed Systems Engineer — AI Platform & Orchestration

fal - Features & Labels • San Francisco (CA)

On-site
USD 180,000 - 250,000
Health insurance
Relocation assistance
Vision insurance
+3