Analytical Evaluator - AI Feedback

Mercor; Greater London; On-site; GBP 32,000 - 52,000; Full time

Job summary

Mercor is seeking a sharp, analytical thinker to evaluate AI-generated responses and provide structured written feedback. You will work independently, following detailed guidelines to produce precise rationales and assessments.

The role emphasizes strong English writing, critical reading, and the ability to identify gaps in reasoning, with no reliance on AI writing tools. This is a great opportunity in AI research evaluation in London.

Qualifications

• Bachelor's degree from a top-500 globally ranked university preferred.
• Strong analytical and written communication skills are required.
• Ability to work independently and follow detailed task guidelines.
• Strong critical reading with ability to identify nuance and gaps in reasoning.
• Ability to write clear, precise, and well-evidenced rationales.
• Consistent, honest judgment and strict attention to detail; no AI writing tools.

Skills

Analytical thinking

Written communication

Independent work

Follow guidelines

Critical reading

No AI tool usage

Education

Bachelor's degree (Top-500 uni)

Job description

Overview

In this role, you will evaluate AI-generated responses and provide structured written feedback. This is a great opportunity for sharp, analytical thinkers to contribute to high-impact AI research projects.

Basic Qualifications

• Bachelor's degree from a top-500 globally ranked university preferred
• Strong analytical and written communication skills
• Ability to work independently and follow detailed task guidelines

Required Skills

• Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning
• Ability to write clear, precise, and well-evidenced written rationales that go beyond surface-level observations
• Consistent and honest judgment, including the ability to give critical assessments when warranted
• Strict attention to detail and accurate application of structured evaluation guidelinesAbility to work entirely without AI writing tools

Eligibility

• Native English fluency required