Staff Software Engineer, Product Quality & Release

Recruiting from Scratch; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Competitive equity package

Onsite in San Francisco

Job summary

Recruiting from Scratch is representing a fast-growing AI infrastructure company behind a widely used LLM gateway. This Staff Software Engineer will own quality across testing, CI, release infrastructure, and provider integrations—building systems that catch regressions without slowing velocity.

You'll stay hands-on, shaping testing strategies, tooling, and release workflows for 100+ LLM APIs, working onsite in San Francisco with a deeply technical IC mindset and a mission to raise the quality

Qualifications

• Senior-to-Staff level software engineer with production systems ownership.
• Experience in a Seed through Series D startup environment.
• Proven track record building test, CI, or release infrastructure.
• Experience with large external API surfaces and provider integrations.
• Strong debugging and root-cause analysis skills.
• Experience designing automated test suites trusted to gate production releases.
• Understanding of CI/CD, release engineering, and production reliability.
• Open-source contributions are a plus.

Responsibilities

• Own product quality end-to-end across a platform integrating with 100+ LLM providers.
• Design and build provider conformance testing (streaming, tool calling, structured outputs, auth, error mapping, cost tracking).
• Build and own CI infrastructure that serves as a release gate.
• Develop automated testing strategies for high open-source contribution volume.
• Build canary testing and synthetic traffic systems to identify upstream changes.
• Design release infrastructure enabling rapid daily shipping with enterprise stability.
• Debug complex failures across unfamiliar code paths, third-party integrations, and provider APIs.
• Perform deep root-cause analysis and convert defects into regression coverage.
• Improve testing architecture, tooling, and release workflows without slowing velocity.
• Raise the technical bar through hands-on coding, architecture decisions, and code reviews.

Skills

Quality ownership

CI/CD

Testing infrastructure

Open-source experience

API integration

Debugging

Release engineering

Platform reliability

Technical ownership

Multi-provider testing

Tools

CI tools

Job description

Recruiting from Scratch is representing a fast-growing AI infrastructure company behind a widely used LLM gateway. This Staff Software Engineer will own quality across testing, CI, release infrastructure, and provider integrations—building systems that catch regressions without slowing velocity.

You'll stay hands-on, shaping testing strategies, tooling, and release workflows for 100+ LLM APIs, working onsite in San Francisco with a deeply technical IC mindset and a mission to raise the quality