Independent AI Evaluator & Feedback Specialist (Remote)

Mercor; New York (NY); Remote; USD 83,000 - 124,000; Full time

Job summary

Mercor is seeking a Generalist Expert for a remote contract role to evaluate AI-generated responses and strengthen model outputs. You will provide structured feedback to improve training data and develop clear, well-evidenced rationales, working independently to meet deadlines.

Applicants should hold a Bachelor's degree, demonstrate strong analytical and written skills, and be fluent in English, with the ability to follow detailed guidelines in a fast-paced environment.

Qualifications

• Bachelor's degree from a top-500 globally ranked university preferred.
• Strong analytical and written communication skills.
• Ability to work independently and follow detailed task guidelines.
• Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning.
• Native English fluency required.

Responsibilities

• Evaluate AI-generated responses to strengthen reasoning and rigor in model outputs.
• Provide structured written feedback to improve training data quality and downstream performance.
• Develop clear, precise, and well-evidenced written rationales.
• Ensure consistent and honest judgment, including critical assessments when warranted.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Skills

Analytical skills

Written communication

Independent work

Critical reading

English fluency

Education

Bachelor's degree

Job description

Mercor is seeking a Generalist Expert for a remote contract role to evaluate AI-generated responses and strengthen model outputs. You will provide structured feedback to improve training data and develop clear, well-evidenced rationales, working independently to meet deadlines.

Applicants should hold a Bachelor's degree, demonstrate strong analytical and written skills, and be fluent in English, with the ability to follow detailed guidelines in a fast-paced environment.