Domain Expert Reviewer - Fully Remote | Upto $85/hr

mercor; San Francisco (CA); Hybrid; AUD 138,000 - 168,000; Part time

Job summary

Mercor connects elite creative and technical talent with leading AI research labs. A remote contract role for a Professional Services Practice Reviewer offers $70-$85/hour, focusing on evaluating AI-generated content, reviewing outputs, and ensuring regulatory compliance.

Strong English and independent work are required. The position emphasizes independent, asynchronous work to deliver high-quality evaluations across domains, with PMP/CPA/CA preferred and a background in PM, law, accounting,

Qualifications

• 5+ years in PM, Law, Accounting, Software Development or IT Management.
• PMP, CPA or CA preferred for relevant roles.
• Near-native business English proficiency.
• Proficiency with spreadsheets and PDFs for reconciliation tasks.

Responsibilities

• Evaluate the accuracy of AI-generated content in your field to ensure it meets professional standards.
• Review AI agent outputs, including tasks, files, and scoresheets, to provide expert judgment.
• Assess domain content for accuracy, consistency, and compliance with standards and regulations.
• Analyze grading results and provide feedback on discrepancies and areas for improvement.
• Defend the scoring of AI work by banding it and comparing it to practitioner standards.
• Work independently and asynchronously to deliver high-quality evaluations.

Skills

Project management

Law

Accounting

Software development

IT management

Tools

Spreadsheets

PDFs

Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Professional Services Practice Reviewer
Type: Contract
Compensation: $70-$85/hour
Location: Remote

Role Responsibilities

• Evaluate the accuracy of AI-generated content in your field to ensure it meets professional standards.
• Review AI agent outputs, including tasks, files, and scoresheets, to provide expert judgment.
• Assess domain content for accuracy, consistency, and compliance with standards and regulations.
• Analyze grading results and provide feedback on discrepancies and areas for improvement.
• Defend the scoring of AI work by banding it and comparing it to practitioner standards.
• Work independently and asynchronously to deliver high-quality evaluations.

Qualifications Must-Have

• 5+ years in Project Management, Law, Accounting, Software Development, or IT Management.
• PMP, CPA, or CA preferred for relevant roles.
• Near-native business English proficiency.
• Proficiency with spreadsheets and PDFs for reconciliation tasks.