Software Engineering Evaluator - Expert

Mercor; Toronto; Remote; CAD 83,000 - 138,000; Full time

Job summary

Mercor is seeking expert Evaluators in Software Engineering to review AI-generated artifacts (slides, spreadsheets, and documents) for real-world quality. You will apply deep subject-matter expertise to grade outputs in a software engineering context.

This is a remote, hourly engagement. Candidates should have 5+ years of software engineering experience and native or professional English fluency, with strong MS Office and Google Workspace skills to provide structured feedback.

Qualifications

• 5+ years of professional software engineering experience at a top firm in the United States, United Kingdom, Canada, Australia, or New Zealand.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace (PowerPoint, Excel, Word).

Responsibilities

• Evaluate AI-generated artifacts for usability in software engineering context.
• Identify factual, aesthetic, and presentation errors.
• Provide clear, structured written feedback.

Skills

English fluency

Software engineering experience

Office software literacy

Education

Master's degree or higher

Tools

Microsoft Office

Google Workspace

Job description

About the role

We are hiring expert Evaluators in Software Engineering to review and assess AI-generated work products (slides, spreadsheets, and documents) for real-world quality. You will apply deep subject-matter expertise to grade outputs.

This is a remote, hourly engagement.

Requirements (must have)

1. 5+ years of relevant professional experience in Software Engineering at a top firm in the United States, United Kingdom, Canada, Australia, or New Zealand.

2. Native or professional fluency in English.

3. Highly proficient in Microsoft Office and Google Workspace (PowerPoint, Excel, Word).

Preferred (nice to have)

• Advanced degree (Master's or higher) from a reputable institution.

What you'll do

• Evaluate AI-generated artifacts for usability in software engineering context.

• Identify factual, aesthetic, and presentation errors.

• Provide clear, structured written feedback.