Senior AI Web Quality Engineer

Adobe; San Francisco (CA); On-site; USD 150,000 - 210,000; Full time

Job summary

Adobe is seeking a Senior Software Quality Engineer to own the quality strategy for a new AI-first web application. You will build and maintain modern web test automation, spanning the prompt/agent layer, in-browser experience, and generated output.

You will stand up evaluation harnesses, ensure performance and accessibility across devices, and embed quality into CI/CD with smart release gates. Collaboration with engineers, product, and design is essential as is adapting to evolving AI tooling.

Qualifications

• Bachelor's degree or equivalent experience in Computer Science or related field.
• 8+ years of customer-facing software quality / SDET experience.
• Automation experience with modern web frameworks (Playwright, Cypress, or similar) and strong coding skills in TypeScript/JavaScript; comfort with Python is a plus.
• Experience designing test strategy for AI / ML / LLM-powered features — prompt regression, evaluation datasets, model drift, timely-injection and safety testing, or equivalent.
• Strong fundamentals in API testing, performance and load testing, and observability tooling (Datadog, Splunk, Sentry, OpenTelemetry, or similar).
• Excellent collaboration and communication; able to influence engineers and PMs early in the build cycle.
• Embrace generative and AI-assisted development workflows, and be eager to learn and adapt as the tooling continues to evolve.
• Thrive in a fast-paced, agile, founding-team environment with real ambiguity.
• Prior experience with creative tools, design-to-code, browser-based graphics (Canvas/WebGL), or real-time collaboration stacks.

Responsibilities

• Own the end-to-end quality strategy for a new AI-first web application, spanning the prompt and agent layer, the in-browser experience, and the generated output.
• Compose, build, and maintain modern web test automation (Playwright / Cypress, TypeScript/JavaScript) and the underlying infrastructure that keeps it fast, deterministic, and developer-friendly.
• Stand up evaluation harnesses for automated workflows: golden prompt suites, regression baselines, model/version comparisons, hallucination and safety checks, and human-in-the-loop review pipelines.
• Ensure comprehensive quality for a real-time web product — performance, resilience, accessibility (WCAG), and cross-browser/cross-device coverage.
• Embed quality into CI/CD: build release gates that catch real regressions, reduce flake, and turn production telemetry into pre-submit signal.
• Work closely with engineering, product, and design to build testability into the process early. Guide engineers on test strategy, automation patterns, and adopting a shift-left outlook.

Skills

SDET experience

API testing

CI/CD

AI testing

Performance testing

Cross-browser testing

Automation strategy

Team collaboration

Education

Bachelor's degree in Computer Science or related field

Tools

Playwright

Cypress

TypeScript

JavaScript

Python

Job description

Adobe is seeking a Senior Software Quality Engineer to own the quality strategy for a new AI-first web application. You will build and maintain modern web test automation, spanning the prompt/agent layer, in-browser experience, and generated output.

You will stand up evaluation harnesses, ensure performance and accessibility across devices, and embed quality into CI/CD with smart release gates. Collaboration with engineers, product, and design is essential as is adapting to evolving AI tooling.