QA Engineer - Browser Test Specialist - AI Trainer

Obsidian; Chicago (IL); On-site; USD 110,000 - 140,000; Full time

Job summary

Obsidian is seeking experienced Software Engineers, QA Engineers, SDETs, and Test Automation Engineers to review browser-based evaluation workflows for AI-generated web applications. You will validate that browser tests are sound, deterministic, and produce clear pass/fail outcomes before they become part of benchmark datasets, and provide structured technical feedback.

Join a high-caliber team focused on establishing quality standards for AI-generated software evaluation and collaborate on

Qualifications

• 3+ years of experience in Software Engineering, QA Engineering, SDET, or Test Automation.
• Experience testing modern web applications.
• Familiarity with browser automation frameworks such as Playwright, Cypress, Selenium, or similar tools.
• Experience writing automated UI and end-to-end tests.
• Strong understanding of test isolation, fixtures, reproducibility, and reliable browser automation.
• Excellent debugging skills and attention to detail.

Responsibilities

• Review browser-based testing workflows for AI-generated web applications.
• Assess whether browser interactions are technically feasible and reliable.
• Validate test isolation, fixtures, setup, and execution flow.
• Ensure assertions produce deterministic, unambiguous pass/fail results.
• Identify flaky tests, hidden dependencies, or ambiguous validation logic.
• Provide structured technical feedback following project review rubrics.

Skills

3+ years experience

Web app testing

End-to-end testing

Debugging skills

QA collaboration

Tools

Playwright

Cypress

Selenium

Job description

We're seeking experienced Software Engineers, QA Engineers, SDETs, and Test Automation Engineers to review browser-based evaluation workflows for AI-generated web applications. You'll validate whether browser tests are technically sound, deterministic, and capable of producing clear pass/fail outcomes before they become part of benchmark datasets.

What You'll Do

• Review browser-based testing workflows for AI-generated web applications.

• Assess whether browser interactions are technically feasible and reliable.

• Validate test isolation, fixtures, setup, and execution flow.

• Ensure assertions produce deterministic, unambiguous pass/fail results.

• Identify flaky tests, hidden dependencies, or ambiguous validation logic.

• Provide structured technical feedback following project review rubrics.

We're Looking For

• 3+ years of experience in Software Engineering, QA Engineering, SDET, or Test Automation.

• Strong experience testing modern web applications.

• Familiarity with browser automation frameworks such as Playwright, Cypress, Selenium, or similar tools.

• Experience writing automated UI and end-to-end tests.

• Strong understanding of test isolation, fixtures, reproducibility, and reliable browser automation.

• Excellent debugging skills and attention to detail.

Why Join?

• Contribute to the development of AI systems by ensuring browser-based evaluation workflows are technically robust and reliable.

• Review realistic web application testing scenarios involving automation, test design, and software quality engineering.

• Collaborate with a high-calibre team helping establish quality standards for AI-generated software evaluation.