Senior QA Engineer: AI Web Testing & Automation

Mercor; Toronto; On-site; CAD 90,000 - 130,000; Full time

Job summary

Mercor is seeking experienced Software Engineers, QA Engineers, SDETs, and Test Automation Engineers to evaluate browser-based evaluation workflows for AI-generated web applications. You will validate determinism, feasibility, and reliability of browser tests before they enter benchmark datasets.

The role focuses on reviewing workflows, assessing test isolation, and ensuring reliable pass/fail outcomes with strong debugging and attention to detail.

Qualifications

• 3+ years of experience in Software Engineering, QA Engineering, SDET, or Test Automation.
• Experience testing modern web applications.
• Familiarity with browser automation frameworks such as Playwright, Cypress, Selenium, or similar tools.
• Experience writing automated UI and end-to-end tests.
• Strong understanding of test isolation, fixtures, reproducibility, and reliable browser automation.
• Excellent debugging skills and attention to detail.

Responsibilities

• Review browser-based testing workflows for AI-generated web applications.
• Assess whether browser interactions are technically feasible and reliable.
• Validate test isolation, fixtures, setup, and execution flow.
• Ensure assertions produce deterministic, unambiguous pass/fail results.
• Identify flaky tests, hidden dependencies, or ambiguous validation logic.
• Provide structured technical feedback following project review rubrics.

Skills

Software testing

Excellent debugging

Attention to detail

Test isolation

Tools

Playwright

Cypress

Selenium

Job description

Mercor is seeking experienced Software Engineers, QA Engineers, SDETs, and Test Automation Engineers to evaluate browser-based evaluation workflows for AI-generated web applications. You will validate determinism, feasibility, and reliability of browser tests before they enter benchmark datasets.

The role focuses on reviewing workflows, assessing test isolation, and ensuring reliable pass/fail outcomes with strong debugging and attention to detail.