Video Evaluation Specialist for AI Research

Mercor; Sydney; Remote; AUD 41,000 - 55,000; Full time

Job summary

Mercor is seeking detail-oriented writing experts to contribute to a high-impact video AI research project with a leading lab. Annotators will watch two short video clips side by side, compare them to a rubric across dimensions such as prompt adherence, motion quality, artifacts, and physical plausibility, and assign scores.

Ideal candidates have strong academic backgrounds and a knack for instructional clarity, with the ability to distill complex concepts into well-crafted text.

Qualifications

• BS or BA from a reputable institution completed or in progress.
• Strong writing and critical thinking skills.
• Ability to work independently and meet deadlines.

Responsibilities

• Evaluate paired video outputs against the rubric.
• Score rubric and justify preferences for each task.
• Maintain consistent standards across high-volume tasks.

Skills

Writing skills

Critical thinking

Attention to detail

Ability to work independently

Deadline-oriented

English proficiency

Education

Bachelor's degree (BS/BA) or in progress

Job description

Mercor is seeking detail-oriented writing experts to contribute to a high-impact video AI research project with a leading lab. Annotators will watch two short video clips side by side, compare them to a rubric across dimensions such as prompt adherence, motion quality, artifacts, and physical plausibility, and assign scores.

Ideal candidates have strong academic backgrounds and a knack for instructional clarity, with the ability to distill complex concepts into well-crafted text.