Senior QA Engineer — AI Agent Platform

Ontrac Solutions LLC.; Chicago (IL); Hybrid; USD 110,000 - 124,000; Full time

Job summary

Agentic AI Platform is seeking a Senior/Staff QA Engineer to own quality end-to-end for a fast-moving AI product. You will craft precise manual test cases and build automated coverage, collaborating with the Delivery Lead and customer engineers from planning through final release.

The role requires 5+ years of QA experience (2+ at senior level), strong ADLC understanding, UI/UX acumen, and hands-on AI agent testing. Proficiency with Playwright, CI/CD, Docker, Git, and Jira is expected.

Qualifications

• 5+ years of QA experience with 2+ years in senior/staff roles.
• Experience testing production software across the ADLC.
• Strong UI/UX evaluation skills and usability focus.
• Hands-on AI agent testing including flows and tool calling.
• Proven automation framework experience and scalable test suites.
• Ability to stand up and manage a Playwright cluster for E2E testing.
• Independently define clear, structured test cases from evolving requirements.
• Experience driving full E2E QA lifecycle: planning, execution, triage, sign-off.

Responsibilities

• Own quality end-to-end for a critical agentic AI platform.
• Collaborate with Delivery Lead/Solutions Architect and customer engineers from test planning to release.
• Write precise manual test cases and build automated coverage.
• Drive defect triage, regression, and sign-off across releases.

Skills

ADLC Expertise

UI/UX Acumen

Automation Frameworks

Autonomy

Lifecycle Ownership

Tools

Playwright

Git

Jira

Docker

CI/CD

Job description

Agentic AI Platform is seeking a Senior/Staff QA Engineer to own quality end-to-end for a fast-moving AI product. You will craft precise manual test cases and build automated coverage, collaborating with the Delivery Lead and customer engineers from planning through final release.

The role requires 5+ years of QA experience (2+ at senior level), strong ADLC understanding, UI/UX acumen, and hands-on AI agent testing. Proficiency with Playwright, CI/CD, Docker, Git, and Jira is expected.