Video Evaluation Specialist - Flexible 20h/wk, Short-Term

Mercor; New York (NY); Remote; USD 21,000 - 34,000; Full time

Job summary

Mercor is seeking detail-oriented writing experts to contribute to a high-impact video AI research project with a leading lab. We’re looking for annotators to evaluate short video clips by watching two videos side by side and scoring them against a rubric.

The role is short-term and flexible, with an expectation of at least 20 hours per week and a commitment of about 1.5 weeks. Ideal candidates have a BS/BA, strong writing and critical thinking skills, and the ability to work independently to

Qualifications

• BS or BA from a reputable institution (completed or in progress).
• Strong writing and critical thinking skills.
• Ability to work independently and meet deadlines.

Responsibilities

• Evaluate paired video outputs by watching two clips side by side and scoring them against the rubric.
• Score and justify preferences, and document a brief written justification where prompted.
• Maintain scoring consistency across high task volumes and ensure reliable judgments.

Skills

Strong writing

Critical thinking

Ability to work independently

Deadline-driven

Education

BS or BA (completed or in progress)

Job description

Mercor is seeking detail-oriented writing experts to contribute to a high-impact video AI research project with a leading lab. We’re looking for annotators to evaluate short video clips by watching two videos side by side and scoring them against a rubric.

The role is short-term and flexible, with an expectation of at least 20 hours per week and a commitment of about 1.5 weeks. Ideal candidates have a BS/BA, strong writing and critical thinking skills, and the ability to work independently to