AI Video Craft Evaluator

Mercor; United States; Remote; USD 75,000 - 150,000; Full time

Job summary

Cincinnatus LLC is seeking part of a cutting-edge AI lab's extended workforce to evaluate AI-generated video comparisons for craft, lighting, framing, continuity, and performance. You will compare videos built from the same prompt and justify why one result stands out from the other.

The role emphasizes precise written feedback and adherence to project guidelines. Ideal candidates have film/theater training or equivalent experience, a keen eye for detail, and strong English writing skills.

Qualifications

• Professional or graduate experience in film/theater or related fields.
• Two+ years practical experience after training, or 4+ years with two theatrical releases.
• A trained eye for detail and ability to describe judgments clearly.
• Fluency in English; second dubbing language a plus.

Responsibilities

• Evaluate pairs of AI-generated videos and select the stronger result on craft axes like lighting, framing, texture, and continuity.
• Explain judgments briefly in the supervisor's language used in dailies.
• Check compliance with the prompt and evaluate camera moves, framing, and performance.
• Participate in calibration rounds to ensure consistency across raters.
• Collaborate with SMEs to ensure accuracy of evaluation data.

Education

Film/theater program + 2+ years experience

Job description

Cincinnatus LLC is seeking part of a cutting-edge AI lab's extended workforce to evaluate AI-generated video comparisons for craft, lighting, framing, continuity, and performance. You will compare videos built from the same prompt and justify why one result stands out from the other.

The role emphasizes precise written feedback and adherence to project guidelines. Ideal candidates have film/theater training or equivalent experience, a keen eye for detail, and strong English writing skills.