Playwright QA Automation Engineer for AI Workflows

BigBear.ai; Columbia (MD); On-site; USD 120,000 - 180,000; Full time

Job summary

BigBear.ai is seeking a QA Automation Engineer to translate requirements into test coverage, build and maintain Playwright tests, and partner with Product and Engineering to enable informed release decisions as the AI platform evolves. We expect strong TS/JS coding, API testing, and CI/CD integration across browser, app, and backend surfaces.

You will own automated coverage, design risk-based validation for complex AI behavior, and ensure auditability, security, and government compliance in

Qualifications

• 4+ years of QA automation engineering experience.
• Experience building and maintaining Playwright tests.
• Strong coding ability in TypeScript or JavaScript with Git.
• Experience with API testing, CI/CD, test isolation, and diagnosing failures.
• Ability to reason about complex requirements and edge cases; communicate with stakeholders.
• Ability to obtain a Department of Defense Secret clearance.
• Experience testing authentication, authorization, permissions, and data separation.
• Familiarity with validating Defense in Depth behavior.

Responsibilities

• Translate requirements into testable outcomes with Product and Engineering.
• Own automated test coverage with Playwright tests and API/test integration.
• Develop a risk-based testing strategy aligned to roadmap and priorities.
• Test conversational AI workflows, including interruptions and timeouts.
• Evaluate AI response quality with criteria for accuracy and grounding.
• Make automation reliable by CI/CD integration and diagnosing flaky tests.
• Communicate release readiness with reproducible evidence and risk notes.
• Document expected behavior and rationales behind testing decisions.
• Cover backend APIs, authentication, billing, token behavior and model routing.
• Control test cost and latency while maintaining signal.
• Automate security-sensitive validation and safe error handling.
• Apply AI-assisted testing tools with critical review and maintenance.

Skills

TypeScript/JavaScript coding

Playwright

Git

CI/CD

Troubleshooting

Test design

Education

Tools

Playwright

API testing

PostgreSQL

SQL

Docker

Kubernetes

Git

Job description

BigBear.ai is seeking a QA Automation Engineer to translate requirements into test coverage, build and maintain Playwright tests, and partner with Product and Engineering to enable informed release decisions as the AI platform evolves. We expect strong TS/JS coding, API testing, and CI/CD integration across browser, app, and backend surfaces.

You will own automated coverage, design risk-based validation for complex AI behavior, and ensure auditability, security, and government compliance in