Senior Software Quality Engineer

Adobe; San Francisco (CA); On-site; USD 150,000 - 210,000; Full time

Job summary

Adobe is seeking a Senior Software Quality Engineer to own the quality strategy for a new AI-first web application. You will build and maintain modern web test automation, spanning the prompt/agent layer, in-browser experience, and generated output.

You will stand up evaluation harnesses, ensure performance and accessibility across devices, and embed quality into CI/CD with smart release gates. Collaboration with engineers, product, and design is essential as is adapting to evolving AI tooling.

Qualifications

• Bachelor's degree or equivalent experience in Computer Science or related field.
• 8+ years of customer-facing software quality / SDET experience.
• Automation experience with modern web frameworks (Playwright, Cypress, or similar) and strong coding skills in TypeScript/JavaScript; comfort with Python is a plus.
• Experience designing test strategy for AI / ML / LLM-powered features — prompt regression, evaluation datasets, model drift, timely-injection and safety testing, or equivalent.
• Strong fundamentals in API testing, performance and load testing, and observability tooling (Datadog, Splunk, Sentry, OpenTelemetry, or similar).
• Excellent collaboration and communication; able to influence engineers and PMs early in the build cycle.
• Embrace generative and AI-assisted development workflows, and be eager to learn and adapt as the tooling continues to evolve.
• Thrive in a fast-paced, agile, founding-team environment with real ambiguity.
• Prior experience with creative tools, design-to-code, browser-based graphics (Canvas/WebGL), or real-time collaboration stacks.

Responsibilities

• Own the end-to-end quality strategy for a new AI-first web application, spanning the prompt and agent layer, the in-browser experience, and the generated output.
• Compose, build, and maintain modern web test automation (Playwright / Cypress, TypeScript/JavaScript) and the underlying infrastructure that keeps it fast, deterministic, and developer-friendly.
• Stand up evaluation harnesses for automated workflows: golden prompt suites, regression baselines, model/version comparisons, hallucination and safety checks, and human-in-the-loop review pipelines.
• Ensure comprehensive quality for a real-time web product — performance, resilience, accessibility (WCAG), and cross-browser/cross-device coverage.
• Embed quality into CI/CD: build release gates that catch real regressions, reduce flake, and turn production telemetry into pre-submit signal.
• Work closely with engineering, product, and design to build testability into the process early. Guide engineers on test strategy, automation patterns, and adopting a shift-left outlook.

Skills

SDET experience

API testing

CI/CD

AI testing

Performance testing

Cross-browser testing

Automation strategy

Team collaboration

Education

Bachelor's degree in Computer Science or related field

Tools

Playwright

Cypress

TypeScript

JavaScript

Python

Job description

The Opportunity

Changing the world through digital experiences is what Adobe's all about. We give everyone — from emerging artists to global brands — everything they need to build and deliver outstanding digital experiences. Our team is developing a new-generation, AI-first web application in an emerging field. This is a new product we are building from scratch, and quality engineering is a core founding‑team focus. We seek a Senior Software Quality Engineer eager to establish standards for a modern web product. If you enjoy creating fast, reliable test systems for innovative web experiences and thrive on the uncertainty involved with workflows guided by AI, we'd love to connect.

What you'll do

• Own the end‑to‑end quality strategy for a new AI‑first web application, spanning the prompt and agent layer, the in‑browser experience, and the generated output.
• Compose, build, and maintain modern web test automation (Playwright / Cypress, TypeScript/JavaScript) and the underlying infrastructure that keeps it fast, deterministic, and developer‑friendly.
• Stand up evaluation harnesses for automated workflows: golden prompt suites, regression baselines, model/version comparisons, hallucination and safety checks, and human‑in‑the‑loop review pipelines.
• Ensure comprehensive quality for a real‑time web product — performance, resilience, accessibility (WCAG), and cross‑browser/cross‑device coverage.
• Embed quality into CI/CD: build release gates that catch real regressions, reduce flake, and turn production telemetry into pre‑submit signal.
• Work closely with engineering, product, and design to build testability into the process early. Guide engineers on test strategy, automation patterns, and adopting a shift‑left outlook.

What you'll need to succeed

• Bachelor's degree or equivalent experience in Computer Science or a related field.
• 8+ years of experience in customer‑facing software quality / SDET positions.
• Automation experience with modern web frameworks (Playwright, Cypress, or similar) and strong coding skills in TypeScript/JavaScript; comfort with Python is a plus.
• Experience designing test strategy for AI / ML / LLM‑powered features — prompt regression, evaluation datasets, model drift, timely‑injection and safety testing, or equivalent.
• Strong fundamentals in API testing, performance and load testing, and observability tooling (Datadog, Splunk, Sentry, OpenTelemetry, or similar).
• Excellent collaboration and communication; able to influence engineers and PMs early in the build cycle.
• Embrace generative and AI‑assisted development workflows, and be eager to learn and adapt as the tooling continues to evolve.
• Thrive in a fast‑paced, agile, founding‑team environment with real ambiguity.
• Prior experience with creative tools, design‑to‑code, browser‑based graphics (Canvas/WebGL), or real‑time collaboration stacks.

Adobe is proud to be an Equal Employment Opportunity employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other protected characteristic. Adobe will consider qualified applicants with arrest or conviction records for employment in accordance with state and local laws and 'fair chance' ordinances.