Analytical Evaluator - AI Feedback - AI Trainer

Mercor; Philadelphia (Philadelphia County); On-site; USD 60,000 - 90,000; Full time

Job summary

Mercor is seeking a detail-oriented analyst to evaluate AI-generated responses and provide structured written feedback. This role is suited for sharp, analytical thinkers who can contribute to high-impact AI research projects.

Candidates should have strong analytical and written communication skills, the ability to work independently, and strict attention to guidelines. Native English proficiency is required.

Qualifications

• Bachelor's degree from a top-ranked university preferred.
• Strong analytical and written communication skills.
• Ability to work independently and follow detailed task guidelines.

Responsibilities

• Evaluate AI-generated responses and provide structured written feedback.
• Contribute to high-impact AI research projects with precise assessments.

Skills

Analytical thinking

Written communication

Independent work

Attention to detail

Critical reading

Evidence-based reasoning

No AI tools

Education

Bachelor's degree

Job description

Overview

In this role, you will evaluate AI-generated responses and provide structured written feedback. This is a great opportunity for sharp, analytical thinkers to contribute to high-impact AI research projects.

Basic Qualifications

• Bachelor's degree from a top-500 globally ranked university preferred
• Strong analytical and written communication skills
• Ability to work independently and follow detailed task guidelines

Required Skills

• Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning
• Ability to write clear, precise, and well-evidenced written rationales that go beyond surface-level observations
• Consistent and honest judgment, including the ability to give critical assessments when warranted
• Strict attention to detail and accurate application of structured evaluation guidelinesAbility to work entirely without AI writing tools

Eligibility

• Native English fluency required