Staff Software Engineer, AI Platform Quality & Release

Recruiting from Scratch LLC; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Competitive equity package

Onsite position in San Francisco

Job summary

Recruiting from Scratch LLC is partnering with a fast-growing AI infrastructure company in San Francisco to hire a Staff Software Engineer focused on product quality across testing, CI, and release infrastructure. You will own complex production systems, drive automated testing, and shape the platform used by 100+ LLM providers.

This deeply technical IC role emphasizes owning quality, constructing scalable testing and release workflows, and contributing to an open-source ecosystem with strong

Qualifications

• Senior-to-Staff level software engineering with ownership of production systems.
• Experience building test, CI, release, or developer infrastructure for complex software.
• Experience with open-source contributions and large external integrations.

Responsibilities

• Own product end-to-end across a platform with 100+ LLM APIs.
• Design and build provider conformance testing (streaming, tool calling, structured outputs).
• Build and own CI infrastructure that serves as a release gate.
• Develop automated testing strategies for high external contribution volume.
• Build canary testing and synthetic traffic systems to catch upstream changes.
• Design release infrastructure enabling rapid daily shipping for enterprise customers.
• Debug complex failures across unfamiliar code paths and third-party APIs.
• Improve testing architecture and developer tooling without slowing velocity.

Skills

Software engineering

CI/CD

Release engineering

Open-source

Debugging

Tools

CI tooling

Testing frameworks

Job description

Recruiting from Scratch LLC is partnering with a fast-growing AI infrastructure company in San Francisco to hire a Staff Software Engineer focused on product quality across testing, CI, and release infrastructure. You will own complex production systems, drive automated testing, and shape the platform used by 100+ LLM providers.

This deeply technical IC role emphasizes owning quality, constructing scalable testing and release workflows, and contributing to an open-source ecosystem with strong