Domain Expert Reviewer - Fully Remote | Upto $85/Hr

Mercor; Sydney; Remote; AUD 96,000 - 117,000; Part time

Job summary

Mercor is seeking a Professional Services Practice Reviewer on a contract basis to evaluate AI-generated content for accuracy and compliance. The role requires near-native English, strong experience across PM/Law/Accounting/Software Dev/IT Management, and proficiency with spreadsheets and PDFs for reconciliation tasks.

The reviewer will assess AI outputs, grading results, and ensure standards are met, working independently and asynchronously from a remote location.

Qualifications

• 5+ years in Project Management, Law, Accounting, Software Development, or IT Management.
• PMP, CPA, or CA preferred for relevant roles.
• Near-native business English proficiency.
• Proficiency with spreadsheets and PDFs for reconciliation tasks.

Responsibilities

• Evaluate the accuracy of AI-generated content to ensure professional standards.
• Review AI agent outputs, including tasks, files, and scoresheets, with expert judgment.
• Assess domain content for accuracy, consistency, and regulatory compliance.
• Analyze grading results and provide feedback on discrepancies and improvements.
• Defend AI work scoring by benchmarking against practitioner standards.
• Work independently and asynchronously to deliver high-quality evaluations.

Skills

5+ years experience

English proficiency

Spreadsheets

PDFs

Tools

Spreadsheets

PDFs

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Professional Services Practice Reviewer Type: Contract Compensation: $70–$85/hour Location: Remote

Role Responsibilities

• Evaluate the accuracy of AI-generated content in your field to ensure it meets professional standards.
• Review AI agent outputs, including tasks, files, and scoresheets, to provide expert judgment.
• Assess domain content for accuracy, consistency, and compliance with standards and regulations.
• Analyze grading results and provide feedback on discrepancies and areas for improvement.
• Defend the scoring of AI work by banding it and comparing it to practitioner standards.
• Work independently and asynchronously to deliver high-quality evaluations.

Qualifications

Must-Have

• 5+ years in Project Management, Law, Accounting, Software Development, or IT Management.
• PMP, CPA, or CA preferred for relevant roles.
• Near-native business English proficiency.
• Proficiency with spreadsheets and PDFs for reconciliation tasks.