Analytical Evaluator - AI Feedback - AI Trainer

mercor; United States; Remote; USD 83,000 - 110,000; Full time

Job summary

Mercor is seeking a Generalist Expert for a remote contract role. You will evaluate AI-generated responses to ensure accuracy and depth in reasoning, and provide structured written feedback to improve AI model outputs.

The ideal candidate has a Bachelor's degree from a top-500 university, strong analytical and written communication skills, the ability to work independently, and native English fluency. This position requires independent, asynchronous work and a commitment to clear, well-evidenced

Qualifications

• Bachelor's degree from a top-500 globally ranked university preferred.
• Strong analytical and written communication skills.
• Ability to work independently and follow detailed task guidelines.
• Strong critical reading skills.
• Native English fluency required.

Responsibilities

• Evaluate AI-generated responses to ensure accuracy and depth in reasoning.
• Provide structured written feedback to improve AI model outputs.
• Identify nuances, implicit meanings, and gaps in reasoning in AI-generated content.
• Write clear, precise, and well-evidenced rationales beyond surface-level observations.
• Work independently and asynchronously to meet deadlines and improve AI model performance.

Skills

Analytical skills

Written communication

Independent work

Critical reading

English fluency

Education

Bachelor's degree (top-500 uni)

Job description

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey.

Position: Generalist Expert

Type: Contract

Compensation: $70/hour

Location: Remote

Role Responsibilities

• Evaluate AI-generated responses to ensure accuracy and depth in reasoning.
• Provide structured written feedback to improve AI model outputs.
• Identify nuances, implicit meanings, and gaps in reasoning in AI-generated content.
• Write clear, precise, and well-evidenced rationales beyond surface-level observations.
• Work independently and asynchronously to meet deadlines and improve AI model performance.

Qualifications

Must-Have

• Bachelor's degree from a top-500 globally ranked university preferred.
• Strong analytical and written communication skills.
• Ability to work independently and follow detailed task guidelines.
• Strong critical reading skills.
• Native English fluency required.

Preferred

• None specified.

Resources & Support

• For details about the interview process and platform information, please check.
• For any help or support, reach out to.

#hiring mercor