QA Engineer: AI Web App Testing & Validation

Obsidian; New York (NY); Remote; USD 90,000 - 130,000; Full time

Job summary

Obsidian is seeking experienced Software Engineers, QA Engineers, SDETs, and Test Automation Engineers to review browser-based evaluation workflows for AI-generated web applications. You will validate that browser tests are reliable, deterministic, and ready for benchmark datasets.

You will collaborate with a high-caliber team to identify flaky tests, ensure proper fixtures and isolation, and provide structured feedback on test design and automation strategies.

Qualifications

• 3+ years of experience in Software Engineering, QA Engineering, SDET, or Test Automation.
• Strong experience testing modern web applications.
• Familiarity with browser automation frameworks such as Playwright, Cypress, Selenium, or similar tools.
• Experience writing automated UI and end-to-end tests.
• Strong understanding of test isolation, fixtures, reproducibility, and reliable browser automation.
• Excellent debugging skills and attention to detail.

Responsibilities

• Review browser-based testing workflows for AI-generated web applications.
• Assess whether browser interactions are technically feasible and reliable.
• Validate test isolation, fixtures, setup, and execution flow.
• Ensure assertions produce deterministic, unambiguous pass/fail results.
• Identify flaky tests, hidden dependencies, or ambiguous validation logic.
• Provide structured technical feedback following project review rubrics.

Skills

Software Engineering

QA Engineering

SDET

Test Automation

Web applications testing

Browser automation

Debugging

Tools

Playwright

Cypress

Selenium

Job description

Obsidian is seeking experienced Software Engineers, QA Engineers, SDETs, and Test Automation Engineers to review browser-based evaluation workflows for AI-generated web applications. You will validate that browser tests are reliable, deterministic, and ready for benchmark datasets.

You will collaborate with a high-caliber team to identify flaky tests, ensure proper fixtures and isolation, and provide structured feedback on test design and automation strategies.