Video Evaluation Analyst for AI Research (Short-Term)

Obsidian; Sydney; On-site; AUD 34,000 - 62,000; Full time

Job summary

Mercor is seeking detail-oriented writing experts to contribute to a high-impact video AI research project with a leading lab. You will watch two short video clips side by side, compare them against a provided rubric, and score them.

This is a short-term, flexible opportunity for professionals with strong academic backgrounds and a knack for instructional clarity. Ideal for those who enjoy distilling complex concepts into well-crafted text.

Qualifications

• BS or BA from a reputable institution completed or in progress.
• Strong writing and critical thinking skills.
• Ability to work independently and meet deadlines.

Responsibilities

• Evaluate paired video outputs and compare them against rubric across dimensions such as prompt adherence, motion quality, visual artifacts, and plausibility.
• Score rubric scores for each clip and justify preferences with a brief written justification.
• Maintain scoring consistency across high task volumes to ensure reliable judgments.

Skills

Strong writing

Critical thinking

Education

BS/BA

Job description

Mercor is seeking detail-oriented writing experts to contribute to a high-impact video AI research project with a leading lab. You will watch two short video clips side by side, compare them against a provided rubric, and score them.

This is a short-term, flexible opportunity for professionals with strong academic backgrounds and a knack for instructional clarity. Ideal for those who enjoy distilling complex concepts into well-crafted text.