Analytical Evaluator - AI Feedback

Mercor; Dublin; On-site; EUR 42,000 - 56,000; Full time

Job summary

Mercor seeks a detail-oriented evaluator to review AI-generated responses and provide structured feedback. The role emphasizes evidence-based reasoning and clear communication to support AI research efforts.

You will work independently, follow detailed task guidelines, and demonstrate strong English writing and analytical skills, contributing to cutting-edge AI projects within a dynamic team.

Qualifications

• Bachelor's degree preferred from a top-500 globally ranked university.
• Strong analytical and written communication skills.
• Ability to work independently and follow detailed task guidelines.
• Native English fluency required.

Responsibilities

• Evaluate AI-generated responses and provide structured written feedback.
• Contribute to high-impact AI research projects.
• Follow detailed task guidelines and maintain quality.

Skills

Analytical thinking

Written communication

Independent work

Critical reading

Evidence-based writing

Attention to detail

Education

Bachelor's degree (top-500 university preferred)

Job description

Overview

In this role, you will evaluate AI-generated responses and provide structured written feedback. This is a great opportunity for sharp, analytical thinkers to contribute to high-impact AI research projects.

Basic Qualifications

• Bachelor's degree from a top-500 globally ranked university preferred
• Strong analytical and written communication skills
• Ability to work independently and follow detailed task guidelines

Required Skills

• Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning
• Ability to write clear, precise, and well-evidenced written rationales that go beyond surface-level observations
• Consistent and honest judgment, including the ability to give critical assessments when warranted
• Strict attention to detail and accurate application of structured evaluation guidelinesAbility to work entirely without AI writing tools

Eligibility

• Native English fluency required