Sr. Staff SDET, Customer Engineering

hims-and-hers; United States; Remote; USD 180,000 - 260,000; Full time

Benefits offered by this job

Flexible or remote work

Salary + equity for full-time

Health and parental benefits

Employee stock purchase plan

Team retreats

Job summary

hims-and-hers is seeking a Senior Quality Engineering leader to set the overall testing direction for critical software systems and to build shared platforms used across teams. You will apply AI across test creation, failure analysis, and release decisions while also designing rigorous evaluation methods for AI-powered product behavior.

You will define quality architecture, establish reusable standards, and drive an AI‑assisted approach spanning test generation, failure triage, and self-healing

Qualifications

• Senior leadership in software development and test engineering.
• Experience designing shared quality platforms, automation frameworks, and scalable test infrastructure.
• Strong understanding of CI/CD and how testing evidence informs safe release decisions.
• Ability to apply AI and agent-based workflows to testing thoughtfully, including guardrails and signal evaluation.
• Experience testing AI or machine-learning features, or building evaluation methods for probabilistic behavior.
• Clear communication and mentoring skills across engineering teams.

Responsibilities

• Define quality architecture and long-term strategy; build automation frameworks and test infrastructure used across teams.
• Establish reusable testing standards and guardrails to reduce brittle, duplicated, or low-value checks.
• Develop AI-assisted testing approaches spanning test generation, selection, failure triage, and self-healing with safeguards.
• Integrate test signals and AI agents into CI/CD release decisions to assess shipping risk.
• Create evaluation suites for non-deterministic AI features, including datasets, scoring, and safety checks.
• Lead technical discussions and mentor engineers while evaluating new tools against quality outcomes.

Job description

Role overview

Set the quality engineering direction for critical software systems while building shared platforms and remaining deeply involved in implementation. A central focus is applying AI across test creation, failure analysis, and release decisions, while also designing rigorous ways to evaluate AI-powered product behavior.

Responsibilities

• Define quality architecture and long-term strategy in line with product and business needs, and build automation frameworks and test infrastructure used across teams.
• Establish reusable testing standards and guardrails that reduce brittle, duplicated, or low-value checks and address reliability risks before they affect customers.
• Develop an AI-assisted testing approach spanning test generation, test selection, failure triage, and self-healing, with safeguards against masking genuine regressions.
• Integrate useful test signals and AI agents into CI/CD release decisions so teams can assess shipping risk.
• Create evaluation suites for non-deterministic AI features, including reference datasets, scoring approaches, and checks for safety, hallucinations, and response consistency.
• Lead technical discussions and mentor engineers while evaluating new tools against measurable quality outcomes.

Requirements

• Senior technical leadership in software development and test engineering, with the ability to set direction across teams and still contribute hands‑on.
• Experience designing shared quality platforms, automation frameworks, and scalable test infrastructure.
• Strong understanding of CI/CD and how testing evidence informs safe release decisions.
• Ability to apply AI and agent‑based workflows to testing thoughtfully, including defining guardrails and evaluating whether they improve signal.
• Experience testing AI or machine‑learning features, or the technical depth to build evaluation methods for probabilistic and non‑deterministic behavior.
• Clear communication and mentoring skills for working across engineering teams.

Nice to have

• Experience with e‑commerce, healthcare, or regulated environments; internationalization testing; or browser and device testing services.
• Work building LLM or machine‑learning evaluation systems, quality engineering communities, open‑source projects, or public writing and talks.

Benefits and work setup

• The source describes flexible or remote work, salary and equity compensation for full-time roles, paid time off and company holidays, health and parental benefits, an employee stock purchase plan, retirement matching, and team retreats.