QA Engineer - Browser Test Specialist

Mercor; New York (NY); On-site; USD 100,000 - 140,000; Full time

Job summary

Mercor is seeking experienced Software QA Engineers, SDETs, and Test Automation Experts to review browser-based evaluation workflows for AI-driven web applications. You will validate test determinism, isolation, and reliability before benchmarks are produced, ensuring clear pass/fail outcomes.

Ideal candidates have 3+ years in software QA or test automation, strong web app testing experience, and proficiency with Playwright, Cypress, or Selenium.

Qualifications

• Minimum 3+ years in Software QA, SDET or test automation.
• Experience with modern web applications and UI tests.
• Strong debugging skills and attention to detail.

Responsibilities

• Review browser-based testing workflows for AI-generated web apps.
• Assess feasibility and reliability of browser interactions.
• Validate test isolation, fixtures, setup and execution flow.
• Ensure deterministic pass/fail results in tests.
• Identify flaky tests and ambiguous validation logic.
• Provide structured technical feedback against rubrics.

Skills

Software QA

Web Testing

Debugging

Test Automation

Attention to detail

Tools

Playwright

Cypress

Selenium

Job description

We're seeking experienced Software Engineers, QA Engineers, SDETs, and Test Automation Engineers to review browser-based evaluation workflows for AI-generated web applications. You'll validate whether browser tests are technically sound, deterministic, and capable of producing clear pass/fail outcomes before they become part of benchmark datasets.

What You'll Do

• Review browser-based testing workflows for AI-generated web applications.

• Assess whether browser interactions are technically feasible and reliable.

• Validate test isolation, fixtures, setup, and execution flow.

• Ensure assertions produce deterministic, unambiguous pass/fail results.

• Identify flaky tests, hidden dependencies, or ambiguous validation logic.

• Provide structured technical feedback following project review rubrics.

We're Looking For

• 3+ years of experience in Software Engineering, QA Engineering, SDET, or Test Automation.

• Strong experience testing modern web applications.

• Familiarity with browser automation frameworks such as Playwright, Cypress, Selenium, or similar tools.

• Experience writing automated UI and end-to-end tests.

• Strong understanding of test isolation, fixtures, reproducibility, and reliable browser automation.

• Excellent debugging skills and attention to detail.

Why Join?

• Contribute to the development of AI systems by ensuring browser-based evaluation workflows are technically robust and reliable.

• Review realistic web application testing scenarios involving automation, test design, and software quality engineering.

• Collaborate with a high-calibre team helping establish quality standards for AI-generated software evaluation.