Senior Software Engineering Evaluator (Remote, Contract)

Mercor; Auckland; Remote; NZD 244,000 - 365,000; Part time

Job summary

Mercor seeks a Software Engineer Expert for a remote contract role. You will evaluate AI-generated artifacts for usability in a software engineering context and identify factual, aesthetic, and presentation errors in slides, spreadsheets, and documents.

Provide clear feedback to improve AI model outputs, apply deep subject-matter expertise to grade outputs, and work independently to meet deadlines while enhancing model performance.

Qualifications

• 5+ years of professional Software Engineering experience at top firms in eligible regions.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace tools.

Responsibilities

• Evaluate AI-generated artifacts for usability in a software engineering context.
• Identify factual, aesthetic, and presentation errors in slides, spreadsheets, and documents.
• Provide clear, structured feedback to improve AI model outputs.
• Apply subject-matter expertise to grade outputs and enhance quality.
• Work independently and asynchronously to meet deadlines.

Skills

5+ yrs exp

Software Engineering

English fluency

Office & Workspace

Education

Master's degree

Tools

Microsoft Office

Google Workspace

Job description

Mercor seeks a Software Engineer Expert for a remote contract role. You will evaluate AI-generated artifacts for usability in a software engineering context and identify factual, aesthetic, and presentation errors in slides, spreadsheets, and documents.

Provide clear feedback to improve AI model outputs, apply deep subject-matter expertise to grade outputs, and work independently to meet deadlines while enhancing model performance.