QA Engineer: AI Web Test Automation & Validation

Obsidian; Chicago (IL); On-site; USD 110,000 - 140,000; Full time

Job summary

Obsidian is seeking experienced Software Engineers, QA Engineers, SDETs, and Test Automation Engineers to review browser-based evaluation workflows for AI-generated web applications. You will validate that browser tests are sound, deterministic, and produce clear pass/fail outcomes before they become part of benchmark datasets, and provide structured technical feedback.

Join a high-caliber team focused on establishing quality standards for AI-generated software evaluation and collaborate on

Qualifications

• 3+ years of experience in Software Engineering, QA Engineering, SDET, or Test Automation.
• Experience testing modern web applications.
• Familiarity with browser automation frameworks such as Playwright, Cypress, Selenium, or similar tools.
• Experience writing automated UI and end-to-end tests.
• Strong understanding of test isolation, fixtures, reproducibility, and reliable browser automation.
• Excellent debugging skills and attention to detail.

Responsibilities

• Review browser-based testing workflows for AI-generated web applications.
• Assess whether browser interactions are technically feasible and reliable.
• Validate test isolation, fixtures, setup, and execution flow.
• Ensure assertions produce deterministic, unambiguous pass/fail results.
• Identify flaky tests, hidden dependencies, or ambiguous validation logic.
• Provide structured technical feedback following project review rubrics.

Skills

3+ years experience

Web app testing

End-to-end testing

Debugging skills

QA collaboration

Tools

Playwright

Cypress

Selenium

Job description

Obsidian is seeking experienced Software Engineers, QA Engineers, SDETs, and Test Automation Engineers to review browser-based evaluation workflows for AI-generated web applications. You will validate that browser tests are sound, deterministic, and produce clear pass/fail outcomes before they become part of benchmark datasets, and provide structured technical feedback.

Join a high-caliber team focused on establishing quality standards for AI-generated software evaluation and collaborate on