Senior QA Engineer - AI Agent Harness

Adobe Inc.; San Francisco (CA); On-site; USD 153,000 - 222,000; Full time

Job summary

Adobe is seeking a Quality Engineer to join the Agentic Harness team in San Francisco. You will design, write, and maintain automated test suites, perform manual testing, and analyze failures to root cause.

You’ll work with engineers and data scientists to harden test coverage for an AI-driven agent system, ensuring reliable behavior, tool use, and outputs before shipping. You’ll thrive in a fast-moving environment, focusing on testing LLM-based capabilities and evolving QA practices from the

Qualifications

• Bachelor's degree in Computer Science or a related field, or equivalent experience.
• Several years of experience in quality engineering, test automation, or QA, ideally on complex, evolving software.
• Hands‑on experience writing automated tests and test frameworks.
• Familiarity with testing LLM‑based or agentic systems and how their behavior differs from traditional software.
• Comfort operating in a fast‑moving, ambiguous environment where the technology and user expectations are evolving quickly.

Responsibilities

• Design, write, and maintain automated test suites and test plans covering the agentic harness's behavior, tool use, and outputs.
• Implement manual and exploratory testing on new agent capabilities, identifying edge cases and failure modes before they reach production.
• Investigate test failures and reported bugs to isolate root cause, working with engineers to reproduce, document, and resolve issues.
• Partner with the Agent Evals team to close coverage gaps and improve the reliability of quality signals.

Skills

Quality engineering

Test automation

QA

LLM testing

Education

Bachelor's degree in Computer Science or related field

Tools

Testing frameworks

Job description

Adobe is seeking a Quality Engineer to join the Agentic Harness team in San Francisco. You will design, write, and maintain automated test suites, perform manual testing, and analyze failures to root cause.

You’ll work with engineers and data scientists to harden test coverage for an AI-driven agent system, ensuring reliable behavior, tool use, and outputs before shipping. You’ll thrive in a fast-moving environment, focusing on testing LLM-based capabilities and evolving QA practices from the