AI Feedback Evaluator & Analysis Specialist

Mercor; San Francisco (CA); On-site; USD 80,000 - 110,000; Full time

Job summary

Obsidian is seeking candidates in San Francisco, California, to evaluate AI-generated responses and provide structured feedback. Ideal candidates will possess a Bachelor's degree from a top-ranked university and strong analytical and communication skills.

As part of a high-impact AI research project, you will assess critical reading and writing abilities, ensuring a consistent and honest evaluation of AI responses. Attention to detail and following guidelines are essential.

Qualifications

• Bachelor's degree from a top-500 globally ranked university preferred.
• Strong analytical and written communication skills.
• Ability to work independently and follow detailed task guidelines.

Responsibilities

• Evaluate AI-generated responses and provide structured written feedback.
• Identify nuance, implicit meaning, and gaps in reasoning.
• Write clear, precise, and well-evidenced written rationales.

Skills

Analytical thinking

Written communication

Critical reading

Attention to detail

Education

Bachelor's degree from a top-500 globally ranked university

Job description

Obsidian is seeking candidates in San Francisco, California, to evaluate AI-generated responses and provide structured feedback. Ideal candidates will possess a Bachelor's degree from a top-ranked university and strong analytical and communication skills.

As part of a high-impact AI research project, you will assess critical reading and writing abilities, ensuring a consistent and honest evaluation of AI responses. Attention to detail and following guidelines are essential.