Senior/Staff QA Engineer – Agentic AI Platform

Ontrac Solutions LLC.; Chicago (IL); Hybrid; USD 110,000 - 124,000; Full time

Job summary

Agentic AI Platform is seeking a Senior/Staff QA Engineer to own quality end-to-end for a fast-moving AI product. You will craft precise manual test cases and build automated coverage, collaborating with the Delivery Lead and customer engineers from planning through final release.

The role requires 5+ years of QA experience (2+ at senior level), strong ADLC understanding, UI/UX acumen, and hands-on AI agent testing. Proficiency with Playwright, CI/CD, Docker, Git, and Jira is expected.

Qualifications

• 5+ years of QA experience with 2+ years in senior/staff roles.
• Experience testing production software across the ADLC.
• Strong UI/UX evaluation skills and usability focus.
• Hands-on AI agent testing including flows and tool calling.
• Proven automation framework experience and scalable test suites.
• Ability to stand up and manage a Playwright cluster for E2E testing.
• Independently define clear, structured test cases from evolving requirements.
• Experience driving full E2E QA lifecycle: planning, execution, triage, sign-off.

Responsibilities

• Own quality end-to-end for a critical agentic AI platform.
• Collaborate with Delivery Lead/Solutions Architect and customer engineers from test planning to release.
• Write precise manual test cases and build automated coverage.
• Drive defect triage, regression, and sign-off across releases.

Skills

ADLC Expertise

UI/UX Acumen

Automation Frameworks

Autonomy

Lifecycle Ownership

Tools

Playwright

Git

Jira

Docker

CI/CD

Job description

Senior/Staff QA Engineer – Agentic AI Platform

• Contract
• $80 – $90 / hour

Overview

We are seeking a highly skilled and experienced Senior/Staff QA Engineer to support a critical customer engagement. This role is ideal for a detail-oriented tester who thrives owning quality end-to-end — someone equally comfortable writing precise manual test cases and building automated coverage for a fast-moving agentic AI product.

The successful candidate will work closely with the Delivery Lead/Solutions Architect and customer engineering stakeholders to ensure product quality from initial test planning through final release.

Required Credentials

• 5+ years of professional QA experience, with at least 2+ years at a senior or staff level.
• Demonstrated experience testing production software through a full Application Development Lifecycle (ADLC).

Required Qualifications

• ADLC Expertise: Strong understanding of the Application Development Lifecycle — from requirements through release and support.
• UI/UX Acumen: Solid UI/UX understanding, with the ability to evaluate usability and flag design/interaction issues, not just functional bugs.
• AI Agent Testing: Hands-on experience testing AI Agent use cases — including conversational flows, agent decision-making, tool/function calling, and edge-case or failure-mode behavior.
• Automation Frameworks: Proven experience with automated testing frameworks and building maintainable, scalable test suites.
• Infrastructure Management: Ability to stand up and manage a Playwright cluster to run automated end-to-end (E2E) testing against a live agent platform.
• Autonomy: Ability to independently define clear, well-structured test cases from ambiguous or evolving product requirements.
• Lifecycle Ownership: Experience driving full E2E QA lifecycle ownership: test planning, execution, defect triage, regression, and sign-off.

Required Technical Stack Experience (Suggested Completion)

• Automation Frameworks: Deep expertise with Playwright (including cluster management and parallel execution).
• AI/LLM Tools: Familiarity with testing LLM outputs, prompt evaluation frameworks, or conversational AI testing tools.
• CI/CD & DevOps: Experience integrating automated test suites into pipelines (e.g., GitHub Actions, GitLab CI, Jenkins) and working with Docker containerization.
• Defect Tracking & Tools: Proficiency with Git, Jira, and modern test management tools.

__________________________________