Senior Software Engineer

Recruiting from Scratch LLC; San Francisco (CA); On-site; USD 200,000 - 300,000; Full time

Benefits offered by this job

Competitive equity package

In-person engineering culture

Ownership and impact emphasis

Collaborative, fast-paced environment

Job summary

Recruiting from Scratch LLC represents an AI infrastructure startup seeking a Senior Software Engineer in San Francisco. You will design, build, deploy, and operate distributed systems supporting hundreds of thousands of concurrent AI agents, shaping the core platform that enables large-scale research with language models.

The role emphasizes technical ownership from architecture to production, with a focus on high throughput, low latency, and memory efficiency.

Qualifications

• 7+ years of professional software engineering experience.
• Proven primary contributor on multiple medium-to-large projects.
• Experience deploying and operating distributed services in production.
• Strong understanding of concurrency, distributed systems, data modeling, and production infrastructure.
• Experience solving scalability challenges involving high-throughput or highly concurrent workloads.
• Strong debugging skills with the ability to diagnose complex issues across distributed systems.
• Demonstrated ability to independently own technically complex projects from initial design through production.
• Strong communication skills with the ability to explain complex technical concepts clearly.

Responsibilities

• Design, build, deploy, and operate distributed systems supporting hundreds of thousands of concurrent AI agents.
• Own medium-to-large engineering initiatives as a primary individual contributor from architecture through production.
• Build infrastructure capable of processing millions of tokens per minute across highly parallel workloads.
• Design systems that safely handle massive numbers of agents concurrently reading from and writing to shared data models.
• Build real-time infrastructure for transmitting agent outputs across backend services to end users.
• Optimize backend systems for write throughput, latency, reliability, and memory efficiency.
• Design and operate production-grade distributed services capable of scaling alongside rapidly increasing AI workloads.
• Debug complex production issues spanning concurrency, distributed state, infrastructure, and application services.
• Serve as a technical resource for other engineers through architecture discussions, debugging, and design reviews.

Skills

Distributed systems

High throughput

Debugging

Independent ownership

Technical leadership

Communication

Tools

Go

Redis

PostgreSQL

S3 object storage

Temporal

Job description

Recruiting from Scratch is a specialized talent firm dedicated to helping companies build exceptional teams. We partner closely with our clients to deeply understand their needs, then connect them with top-tier candidates who are not only highly skilled but also the right fit for the company’s culture and vision. Our mission is simple: place the best people in the right roles to drive long-term success for both clients and candidates. https://www.recruitingfromscratch.com/

Senior Software Engineer

Company Stage of Funding:

AI Infrastructure Startup

Office Type:

Onsite (5 Days Per Week)

Company Description

We're representing an AI infrastructure company building a new workspace that enables knowledge workers to conduct massive-scale research using large language models. Their platform orchestrates hundreds of thousands of AI agents simultaneously, processing millions of tokens per minute and compressing research workflows that previously took days into seconds.

The engineering challenges are deeply technical and highly distributed—from managing race conditions across 100,000+ concurrent agents to transmitting outputs across services in real time and optimizing massive write throughput without sacrificing memory efficiency. This is an opportunity for an experienced engineer to serve as a primary technical owner on some of the hardest distributed systems problems emerging from large-scale agentic AI.

What You Will Do

• Design, build, deploy, and operate distributed systems supporting hundreds of thousands of concurrent AI agents.
• Own medium-to-large engineering initiatives as a primary individual contributor from architecture through production.
• Build infrastructure capable of processing millions of tokens per minute across highly parallel workloads.
• Design systems that safely handle massive numbers of agents concurrently reading from and writing to shared data models.
• Build real-time infrastructure for transmitting agent outputs across backend services to end users.
• Optimize backend systems for write throughput, latency, reliability, and memory efficiency.
• Design and operate production-grade distributed services capable of scaling alongside rapidly increasing AI workloads.
• Debug complex production issues spanning concurrency, distributed state, infrastructure, and application services.
• Serve as a technical resource for other engineers through architecture discussions, debugging, and design reviews.
• Help establish engineering patterns and technical foundations for large-scale agent orchestration.

Ideal Background

• 7+ years of professional software engineering experience.
• Proven track record as the primary individual contributor on multiple medium-to-large technical projects.
• Deep experience designing, deploying, and operating distributed services in production.
• Strong understanding of concurrency, distributed systems, data modeling, and production infrastructure.
• Experience solving scalability challenges involving high-throughput or highly concurrent workloads.
• Strong debugging skills with the ability to diagnose complex issues across distributed systems.
• Demonstrated ability to independently own technically complex projects from initial design through production.
• Strong communication skills with the ability to explain complex technical concepts clearly.
• Track record of becoming a trusted technical resource for other engineers.

Preferred

• Professional experience with Go.
• Experience building high-throughput systems using Redis.
• Familiarity with Pub/Sub architectures and event-driven distributed systems.
• Strong experience with PostgreSQL and production data systems.
• Familiarity with S3 or similar object storage infrastructure.
• Experience with Temporal or other durable workflow orchestration systems.
• Background building real-time systems or infrastructure supporting extremely high concurrency.
• Experience with AI infrastructure, agent orchestration, or large-scale LLM applications.
• Strong technical leadership as an individual contributor, regardless of formal title.

Compensation and Benefits

• Competitive equity package.
• Opportunity to solve novel distributed systems challenges created by orchestrating hundreds of thousands of AI agents simultaneously.
• Significant technical ownership with an emphasis on engineering ability and demonstrated impact rather than title or corporate seniority.
• Highly collaborative, in-person engineering culture focused on solving complex technical problems quickly.