Senior QA Engineer — AI Agent Platform Quality Champion

Ontrac Solutions; Chicago (IL); On-site; USD 120,000 - 150,000; Full time

Job summary

Ontrac Solutions is seeking a Senior/Staff QA Engineer to own end-to-end quality for a critical AI product. You will write precise manual tests and build automated coverage, collaborating with Delivery Lead/Solutions Architect and customer engineering teams.

Ideal candidates have 5+ years of QA, with 2+ at senior level, strong ADLC understanding, UI/UX sensibility, and hands-on Playwright-based automation across CI/CD pipelines, Docker, and modern defect tracking.

Qualifications

• 5+ years of professional QA experience, with at least 2+ years at a senior or staff level.
• Demonstrated experience testing production software through a full ADLC.
• Experience testing AI Agent use cases – conversational flows, tool calling, edge-case behavior.
• Proven experience with automated testing frameworks and building maintainable test suites.
• Ability to stand up and manage a Playwright cluster for E2E testing against a live agent platform.
• Autonomy to define clear test cases from evolving requirements.
• Experience driving full E2E QA lifecycle ownership: test planning, execution, defect triage, regression, sign-off.

Responsibilities

• Own end-to-end QA lifecycle, from planning to sign-off.
• Develop and execute test plans for AI agent workflows.
• Build and maintain automated coverage with Playwright in CI/CD environments.

Skills

Playwright

JavaScript/TypeScript

Python

AI/LLM Testing

UI/UX

Autonomy

Lifecycle Ownership

Defect Tracking

Tools

Git

Jira

Docker

GitHub Actions

Job description

Ontrac Solutions is seeking a Senior/Staff QA Engineer to own end-to-end quality for a critical AI product. You will write precise manual tests and build automated coverage, collaborating with Delivery Lead/Solutions Architect and customer engineering teams.

Ideal candidates have 5+ years of QA, with 2+ at senior level, strong ADLC understanding, UI/UX sensibility, and hands-on Playwright-based automation across CI/CD pipelines, Docker, and modern defect tracking.