Senior Software Quality Engineer, Agentic Harness

Adobe

San Francisco (CA)

On-site

USD 153,000 - 222,000

Full time

2 days ago
Be an early applicant
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Adobe is seeking a Quality Engineer for the Agentic Harness team in San Francisco, CA. You will validate the agent’s behavior, tool use, and outputs to ensure quality before shipping.

You’ll work with engineers and data scientists to catch regressions early, strengthen test coverage, and help the team ship quickly without breaking existing functionality.

Qualifications

  • Bachelor’s degree in CS or related field, or equivalent experience.
  • Several years of quality engineering or QA experience on complex software.
  • Hands-on with automated tests and test frameworks; strong test design and coverage.
  • Ability to diagnose root cause across a stack and fix issues.

Responsibilities

  • Design, write, and maintain automated test suites and plans covering harness behavior, tool use, and outputs.
  • Implement manual and exploratory testing on new agent capabilities, identifying edge cases and failure modes.
  • Investigate test failures and reported bugs to isolate root cause, collaborate with engineers to reproduce, document, and resolve issues.
  • Partner with the Agent Evals team to close coverage gaps and improve reliability of quality signals.

Skills

Quality engineering
Test automation
Bug investigation
LLM testing

Education

Bachelor’s degree in Computer Science

Job description

The Opportunity

Adobe is reimagining the future of creativity, where generative AI and human imagination work together. As a Quality Engineer on the Agentic Harness team, you’ll help the harness behave the way creators expect. You’ll verify that the agent’s behavior, tool use, and outputs meet Adobe’s quality and reliability bar before they ship. You’ll work closely with engineers and data scientists to catch regressions early and harden test coverage. You’ll help the team ship quickly without breaking what already works.

What You’ll Do
  • Design, write, and maintain automated test suites and test plans covering the agentic harness’s behavior, tool use, and outputs.
  • Implement manual and exploratory testing on new agent capabilities, identifying edge cases and failure modes before they reach production.
  • Investigate test failures and reported bugs to isolate root cause, working with engineers to reproduce, document, and resolve issues.
  • Partner with the Agent Evals team to close coverage gaps and improve the reliability of quality signals.
What You’ll Need To Succeed
  • Bachelor’s degree in Computer Science or a related field, or equivalent experience.
  • Several years of experience in quality engineering, test automation, or QA, ideally on complex, evolving software.
  • Hands‑on experience writing automated tests and test frameworks. Solid grasp of test design fundamentals, including coverage, edge cases, and regression risk.
  • Comfort digging into bugs and failures across a stack to identify root cause, not just report symptoms.
  • Familiarity with testing LLM‑based or agentic systems and how their behavior differs from traditional software.
  • Comfort operating in a fast‑moving, ambiguous environment where the technology and user expectations are evolving quickly.
About Adobe

Adobe empowers everyone to create through innovative platforms and tools that unleash creativity, productivity and personalized customer experiences. Adobe’s industry‑leading offerings including Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud, Adobe Experience Platform, Adobe Experience Manager, and GenStudio enable people and businesses to turn ideas into impact, powered by AI and driven by human ingenuity.

Our 30,000+ employees worldwide are creating the future and raising the bar as we drive the next decade of growth. We’re on a mission to hire the very best and believe in creating a company culture where all employees are empowered to make an impact. At Adobe, we believe that great ideas can come from anywhere in the organization. The next big idea could be yours.

Let’s Adobe together

At Adobe, we believe in creating a company culture where all employees are empowered to make an impact. Learn more about Adobe life, including our values and culture, focus on people, purpose and community, Adobe for All, comprehensive benefits programs, the stories we tell, the customers we serve, and how you can help us advance our mission of empowering everyone to create.

Adobe is proud to be an Equal Employment Opportunity employer.

We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other protected characteristic. Learn more.

Adobe aims to make our Careers website and recruiting process accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email accommodations@adobe.com.

AI Use Guidelines for Interviews

Our interviews are designed to reflect your own skills and thinking. The use of AI or recording tools during live interviews is not permitted unless explicitly invited by the interviewer or approved in advance as part of a reasonable accommodation. If these tools are used inappropriately or in a way that misrepresents your work, your application may not move forward in the process.

At Adobe, we empower employees to innovate with AI — and we look for candidates eager to do the same. As part of the hiring experience, we provide clear guidance on where AI is encouraged during the process and where it’s restricted during live interviews. See how we think about AI in the hiring experience.

Expected Pay Range

Our compensation reflects the cost of labor across several U.S. geographic markets, and we pay differently based on those defined markets. The U.S. pay range for this position is $113,400 - $221,750 annually. Pay within this range varies by work location and may also depend on job‑related knowledge, skills, and experience. Your recruiter can share more about the specific salary range for the job location during the hiring process. In California, the pay range for this position is $153,200 - $221,750. In New York, the pay range for this position is $153,200 - $221,750. In Washington, the pay range for this position is $142,500 - $206,275.

In addition, certain roles may be eligible for long‑term incentives in the form of a new hire equity award.

State-Specific Notices
California
Fair Chance Ordinances

Adobe will consider qualified applicants with arrest or conviction records for employment in accordance with state and local laws and “fair chance” ordinances.

Colorado

Application Window Notice. If this role is open to hiring in Colorado (as listed on the job posting), the application window will remain open until at least the date and time stated above in Pacific Time, in compliance with Colorado pay transparency regulations. If this role does not have Colorado listed as a hiring location, no specific application window applies, and the posting may close at any time based on hiring needs.

Massachusetts

Massachusetts Legal Notice. It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Software Quality Engineer, Agentic Harness
Senior Software Quality Engineer, Agentic Harness

Adobe • New York (NY)

On-site
USD 153,000 - 222,000
Senior Software Quality Engineer, Agentic Harness
Senior Software Quality Engineer, Agentic Harness

Adobe Inc. • San Francisco (CA)

On-site
USD 153,000 - 222,000
Senior Software Quality Engineer
Senior Software Quality Engineer

Adobe Inc. • California (MO)

On-site
USD 113,000 - 222,000
Senior Engineer, AI Edge
Senior Engineer, AI Edge

Adobe • San Jose (CA)

On-site
USD 178,000 - 258,000
Senior Software Engineer, Agentic Systems
Senior Software Engineer, Agentic Systems

Adobe Inc. • San Jose (CA)

On-site
USD 183,000 - 265,000
Director, Engineering – Agentic Product
Director, Engineering – Agentic Product

Adobe • San Francisco (CA)

On-site
USD 265,000 - 385,000
Senior Engineer, AI Edge
Senior Engineer, AI Edge

Adobe Inc. • San Jose (CA)

On-site
USD 178,000 - 258,000
Equal Employment Opportunity employer
Core Agent Engineer
Core Agent Engineer

Adobe • Town of Montana (WI)

On-site
USD 159,000 - 302,000
Senior Full-Stack Software Engineer
Senior Full-Stack Software Engineer

Adobe • San Francisco (CA)

On-site
USD 208,000 - 302,000
Principal Product Manager - AI for Engineering
Principal Product Manager - AI for Engineering

Adobe Inc. • Seattle (WA)

On-site
USD 179,000 - 259,000