Analytical Evaluator - AI Feedback

Obsidian; San Francisco (CA); On-site; USD 80,000 - 110,000; Full time

Job summary

Obsidian is seeking candidates in San Francisco, California, to evaluate AI-generated responses and provide structured feedback. Ideal candidates will possess a Bachelor's degree from a top-ranked university and strong analytical and communication skills.

As part of a high-impact AI research project, you will assess critical reading and writing abilities, ensuring a consistent and honest evaluation of AI responses. Attention to detail and following guidelines are essential.

Qualifications

• Bachelor's degree from a top-500 globally ranked university preferred.
• Strong analytical and written communication skills.
• Ability to work independently and follow detailed task guidelines.

Responsibilities

• Evaluate AI-generated responses and provide structured written feedback.
• Identify nuance, implicit meaning, and gaps in reasoning.
• Write clear, precise, and well-evidenced written rationales.

Skills

Analytical thinking

Written communication

Critical reading

Attention to detail

Education

Bachelor's degree from a top-500 globally ranked university

Job description

Overview

In this role, you will evaluate AI-generated responses and provide structured written feedback. This is a great opportunity for sharp, analytical thinkers to contribute to high-impact AI research projects.

Basic Qualifications

• Bachelor's degree from a top-500 globally ranked university preferred
• Strong analytical and written communication skills
• Ability to work independently and follow detailed task guidelines

Required Skills

• Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning
• Ability to write clear, precise, and well-evidenced written rationales that go beyond surface-level observations
• Consistent and honest judgment, including the ability to give critical assessments when warranted
• Strict attention to detail and accurate application of structured evaluation guidelines