QA Engineer - Browser Test Specialist

Mercor; Toronto; On-site; CAD 90,000 - 130,000; Full time

Job summary

Mercor is seeking experienced Software Engineers, QA Engineers, SDETs, and Test Automation Engineers to evaluate browser-based evaluation workflows for AI-generated web applications. You will validate determinism, feasibility, and reliability of browser tests before they enter benchmark datasets.

The role focuses on reviewing workflows, assessing test isolation, and ensuring reliable pass/fail outcomes with strong debugging and attention to detail.

Qualifications

• 3+ years of experience in Software Engineering, QA Engineering, SDET, or Test Automation.
• Experience testing modern web applications.
• Familiarity with browser automation frameworks such as Playwright, Cypress, Selenium, or similar tools.
• Experience writing automated UI and end-to-end tests.
• Strong understanding of test isolation, fixtures, reproducibility, and reliable browser automation.
• Excellent debugging skills and attention to detail.

Responsibilities

• Review browser-based testing workflows for AI-generated web applications.
• Assess whether browser interactions are technically feasible and reliable.
• Validate test isolation, fixtures, setup, and execution flow.
• Ensure assertions produce deterministic, unambiguous pass/fail results.
• Identify flaky tests, hidden dependencies, or ambiguous validation logic.
• Provide structured technical feedback following project review rubrics.

Skills

Software testing

Excellent debugging

Attention to detail

Test isolation

Tools

Playwright

Cypress

Selenium

Job description

We're seeking experienced Software Engineers, QA Engineers, SDETs, and Test Automation Engineers to review browser-based evaluation workflows for AI-generated web applications. You'll validate whether browser tests are technically sound, deterministic, and capable of producing clear pass/fail outcomes before they become part of benchmark datasets.

What You'll Do

• Review browser-based testing workflows for AI-generated web applications.

• Assess whether browser interactions are technically feasible and reliable.

• Validate test isolation, fixtures, setup, and execution flow.

• Ensure assertions produce deterministic, unambiguous pass/fail results.

• Identify flaky tests, hidden dependencies, or ambiguous validation logic.

• Provide structured technical feedback following project review rubrics.

We're Looking For

• 3+ years of experience in Software Engineering, QA Engineering, SDET, or Test Automation.

• Strong experience testing modern web applications.

• Familiarity with browser automation frameworks such as Playwright, Cypress, Selenium, or similar tools.

• Experience writing automated UI and end-to-end tests.

• Strong understanding of test isolation, fixtures, reproducibility, and reliable browser automation.

• Excellent debugging skills and attention to detail.

Why Join?

• Contribute to the development of AI systems by ensuring browser-based evaluation workflows are technically robust and reliable.

• Review realistic web application testing scenarios involving automation, test design, and software quality engineering.

• Collaborate with a high-calibre team helping establish quality standards for AI-generated software evaluation.