Senior Software Engineer

Recruiting from Scratch LLC; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Competitive equity package

In-person engineering culture

Job summary

Recruiting from Scratch LLC is seeking a Senior Software Engineer to own architecture and implementation of distributed systems for AI agent orchestration. You will design and operate scalable backend services in a fast-paced, in-person setting in San Francisco.

The role emphasizes technical ownership, deep debugging skills, and leadership in implementing high-throughput infrastructure for real-time agent communication.

Qualifications

• 7+ years of professional software engineering experience.
• Primary individual contributor on multiple medium-to-large technical projects.
• Deep experience designing, deploying, and operating distributed services in production.
• Strong understanding of concurrency, distributed systems, data modeling, and production infrastructure.
• Experience solving scalability challenges with high-throughput or highly concurrent workloads.

Responsibilities

• Design, build, deploy, and operate distributed systems supporting hundreds of thousands of concurrent AI agents.
• Own medium-to-large engineering initiatives as a primary individual contributor from architecture through production.
• Build infrastructure capable of processing millions of tokens per minute across highly parallel workloads.
• Design systems handling massive numbers of agents reading from and writing to shared data models.
• Build real-time infrastructure for transmitting agent outputs across backend services to end users.
• Debug complex production issues spanning concurrency, distributed state, infrastructure, and application services.

Skills

Distributed systems design

Concurrency

Debugging complex systems

Technical leadership

Communication

Independent ownership

Tools

Go

Redis

PostgreSQL

S3

Temporal

Pub/Sub

Job description

Senior Software Engineer

Company Stage of Funding: AI Infrastructure Startup

Office Type: Onsite (5 Days Per Week)

Company Description

We're representing an AI infrastructure company building a new workspace that enables knowledge workers to conduct massive-scale research using large language models. Their platform orchestrates hundreds of thousands of AI agents simultaneously, processing millions of tokens per minute and compressing research workflows that previously took days into seconds.

The engineering challenges are deeply technical and highly distributed—from managing race conditions across 100,000+ concurrent agents to transmitting outputs across services in real time and optimizing massive write throughput without sacrificing memory efficiency. This is an opportunity for an experienced engineer to serve as a primary technical owner on some of the hardest distributed systems problems emerging from large-scale agentic AI.

What You Will Do

• Design, build, deploy, and operate distributed systems supporting hundreds of thousands of concurrent AI agents.
• Own medium-to-large engineering initiatives as a primary individual contributor from architecture through production.
• Build infrastructure capable of processing millions of tokens per minute across highly parallel workloads.
• Design systems that safely handle massive numbers of agents concurrently reading from and writing to shared data models.
• Build real-time infrastructure for transmitting agent outputs across backend services to end users.
• Optimize backend systems for write throughput, latency, reliability, and memory efficiency.
• Design and operate production-grade distributed services capable of scaling alongside rapidly increasing AI workloads.
• Debug complex production issues spanning concurrency, distributed state, infrastructure, and application services.
• Serve as a technical resource for other engineers through architecture discussions, debugging, and design reviews.
• Help establish engineering patterns and technical foundations for large-scale agent orchestration.

Ideal Background

• 7+ years of professional software engineering experience.
• Proven track record as the primary individual contributor on multiple medium-to-large technical projects.
• Deep experience designing, deploying, and operating distributed services in production.
• Strong understanding of concurrency, distributed systems, data modeling, and production infrastructure.
• Experience solving scalability challenges involving high-throughput or highly concurrent workloads.
• Strong debugging skills with the ability to diagnose complex issues across distributed systems.
• Demonstrated ability to independently own technically complex projects from initial design through production.
• Strong communication skills with the ability to explain complex technical concepts clearly.
• Track record of becoming a trusted technical resource for other engineers.

Preferred

• Professional experience with Go.
• Experience building high-throughput systems using Redis.
• Familiarity with Pub/Sub architectures and event-driven distributed systems.
• Strong experience with PostgreSQL and production data systems.
• Familiarity with S3 or similar object storage infrastructure.
• Experience with Temporal or other durable workflow orchestration systems.
• Background building real-time systems or infrastructure supporting extremely high concurrency.
• Experience with AI infrastructure, agent orchestration, or large-scale LLM applications.
• Strong technical leadership as an individual contributor, regardless of formal title.

Compensation and Benefits

• Competitive equity package.
• Opportunity to solve novel distributed systems challenges created by orchestrating hundreds of thousands of AI agents simultaneously.
• Significant technical ownership with an emphasis on engineering ability and demonstrated impact rather than title or corporate seniority.
• Highly collaborative, in-person engineering culture focused on solving complex technical problems quickly.