QA Automation Engineer: AI Workflows & Release Readiness

Bigbear.ai; Northern (KY); Hybrid; USD 110,000 - 170,000; Full time

Job summary

BigBear.ai is seeking a QA Automation Engineer to translate nuanced product requirements into effective test coverage and build robust Playwright automation. You will own automated coverage across browser, application, and backend boundaries, handling AI workflows, and contributing to release readiness with evidence-based reporting.

You will design risk-based coverage, validate streaming responses and tool executions, and collaborate with Product and Engineering to ensure auditability and

Qualifications

• 4+ years of QA automation experience.
• Experience building and maintaining Playwright tests with fixtures, locators, assertions, and network handling.
• Strong coding in TypeScript or JavaScript and Git workflow.
• Experience with API testing, CI/CD integration, and cross-boundary testing.
• Ability to reason about complex requirements and communicate defects clearly.

Responsibilities

• Translate requirements into testable outcomes and define acceptance criteria with Product and Engineering.
• Own automated test coverage across browser, application, and backend boundaries.
• Design risk-based testing coverage for AI workflows and complex feature interactions.
• Evaluate AI response quality with datasets and scoring criteria.
• Integrate tests into CI/CD and provide actionable failure diagnostics.
• Report defects with reproducible evidence and assess release risk prior to UAT.

Skills

QA automation

Playwright

TypeScript/JavaScript

API testing

CI/CD

Debugging

Git

Tools

Playwright

Git

Docker

Kubernetes

PostgreSQL

Job description

BigBear.ai is seeking a QA Automation Engineer to translate nuanced product requirements into effective test coverage and build robust Playwright automation. You will own automated coverage across browser, application, and backend boundaries, handling AI workflows, and contributing to release readiness with evidence-based reporting.

You will design risk-based coverage, validate streaming responses and tool executions, and collaborate with Product and Engineering to ensure auditability and