Domain Expert Reviewer - Fully Remote | Upto $85/Hr

Mercor; Auckland; Remote; NZD 171,000 - 208,000; Part time

Job summary

Mercor connects elite creative and technical talent with leading AI research labs. This contract, remote role demands 5+ years in PM, law, accounting, software development, or IT management, with PMP/CPA/CA preferred. Strong English and data handling with spreadsheets and PDFs are essential. You will evaluate AI outputs and ensure compliance, working independently to deliver high-quality reviews.

Qualifications

• 5+ years in Project Management, Law, Accounting, Software Development, or IT Management.
• PMP, CPA, or CA preferred for relevant roles.
• Near-native business English proficiency.
• Proficiency with spreadsheets and PDFs for reconciliation tasks.

Responsibilities

• Evaluate the accuracy of AI-generated content in your field to ensure it meets professional standards.
• Review AI agent outputs, including tasks, files, and scoresheets, to provide expert judgment.
• Assess domain content for accuracy, consistency, and compliance with standards and regulations.
• Analyze grading results and provide feedback on discrepancies and areas for improvement.
• Defend the scoring of AI work by banding it and comparing it to practitioner standards.
• Work independently and asynchronously to deliver high-quality evaluations.

Skills

English proficiency

Tools

Spreadsheets

PDFs

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Professional Services Practice Reviewer Type: Contract Compensation: $70–$85/hour Location: Remote

Role Responsibilities

• Evaluate the accuracy of AI-generated content in your field to ensure it meets professional standards.
• Review AI agent outputs, including tasks, files, and scoresheets, to provide expert judgment.
• Assess domain content for accuracy, consistency, and compliance with standards and regulations.
• Analyze grading results and provide feedback on discrepancies and areas for improvement.
• Defend the scoring of AI work by banding it and comparing it to practitioner standards.
• Work independently and asynchronously to deliver high-quality evaluations.

Qualifications

Must-Have

• 5+ years in Project Management, Law, Accounting, Software Development, or IT Management.
• PMP, CPA, or CA preferred for relevant roles.
• Near-native business English proficiency.
• Proficiency with spreadsheets and PDFs for reconciliation tasks.