Staff Software Engineer, Product — AI Platform Quality

Recruiting from Scratch LLC; San Francisco (CA); On-site; USD 180,000 - 260,000; Full time

Benefits offered by this job

Competitive equity package

Onsite in San Francisco

Job summary

Recruiting from Scratch is representing a fast-growing AI infrastructure company building an open-source gateway for 100+ LLM providers. We seek a Staff Engineer to own quality across testing, CI, release infrastructure, and provider integrations, ensuring automated catch of regressions without slowing velocity.

The role is a deeply technical IC position focused on setting the quality bar for a high-scale AI developer platform, with onsite work in San Francisco.

Qualifications

• Senior to Staff level software engineering with ownership of production systems.
• Proven experience in Seed through Series D startup environments.
• Experience building test, CI, release, or developer infrastructure for complex prod software.

Responsibilities

• Own product end-to-end across a platform with 100+ LLM providers.
• Design and build provider conformance testing incl. streaming, tool calling, and authentication.
• Build and own CI infrastructure that acts as a release gate.
• Develop automated testing strategies for high external contribution volumes.
• Build canary testing and synthetic traffic to detect upstream changes.
• Design release infra enabling rapid daily shipping with enterprise stability.

Skills

Senior/Staff

CI/CD

Testing infra

Open source

Debugging

Tools

CI/CD tooling

Release automation

Job description

Recruiting from Scratch is representing a fast-growing AI infrastructure company building an open-source gateway for 100+ LLM providers. We seek a Staff Engineer to own quality across testing, CI, release infrastructure, and provider integrations, ensuring automated catch of regressions without slowing velocity.

The role is a deeply technical IC position focused on setting the quality bar for a high-scale AI developer platform, with onsite work in San Francisco.