Film & VFX Expert - Evaluator

Mercor; Los Angeles (CA); On-site; USD 90,000 - 130,000; Full time

Job summary

Cincinnatus LLC is seeking professionals with film, theater, or related experience to join a cutting‑edge AI evaluation team in Los Angeles. You will compare AI‑generated videos to assess craft across lighting, framing, texture, and performance, and provide precise feedback aligned with supervisor guidance.

The role requires strong written communication and the ability to work at least 20 hours per week, with collaboration among experts to ensure data quality and consistency in ongoing

Qualifications

• Experience in film, theater, or related fields and ability to judge craft on screen, such as lighting, framing, texture, and performance.
• Fluent English with ability to describe judgments clearly and succinctly in supervisor-style language.
• Proven ability to work 20+ hours/week during weekdays and to write precise, actionable feedback.

Responsibilities

• Evaluate pairs of AI-generated videos and choose the stronger result on craft axes: lighting, framing, camera direction, texture, continuity, and acting.
• Write concise, specific reasons for judgments, mirroring professional dailies language.
• Verify video results against prompts and required camera moves, framing, or performance.
• Participate in calibration rounds to keep judgments consistent across evaluators and flag unclear prompts.
• Collaborate with other subject matter experts to ensure data accuracy and consistency.

Skills

Film/theater experience

English fluency

Strong written communication

Attention to detail in video

Education

Film/theater program training

2+ years practical experience

Tools

Video review setup

Job description

Join a leading AI lab's cutting-edge research team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced AI models.

1. Overview

Join a leading AI lab's cutting-edge research team and help shape how its next generation of video models is judged. We're seeking film, theater and visual effects professionals who understand how a shot is built, from lighting and grade to framing, camera movement, continuity, texture and performance, to compare AI-generated video side by side and explain which result holds up to a professional eye. This work is ongoing, with new rounds as new models are released.

This is a W-2 employment position with Cincinnatus LLC (or appropriate international entity), with the opportunity to be placed at a leading AI Lab as part of their extended workforce.

2. Key Responsibilities

• Evaluate pairs of AI-generated videos made from the same prompt and choose the stronger result on specific craft axes: lighting and grade, framing and composition, camera and lens direction, texture and physical realism, shot continuity, and acting and dialogue delivery.
• Write short, precise reasons for each judgment that name what worked and what broke, in the language a supervisor would use in dailies.
• Check each video against its prompt, including whether the requested camera move, lens, framing or performance was actually delivered.
• Take part in calibration rounds with other raters so judgments stay consistent across the pool, and flag prompts or guidelines that are unclear.
• Collaborate with other subject matter experts to ensure consistency and accuracy in evaluation data.

3. Core Qualifications

• Professional or graduate experience in at least one of the following: film or theater (including current graduate students), character animation focused on human performance, character technical direction, acting coaching or teaching, directing (especially crowd and background action), assistant directing, compositing, lighting, texture or surfacing, render wrangling, color or digital imaging (assistant colorist or DIT), camera department (1st AC or camera operator), editing, or display and AV quality assurance.
• Either training at a respected film, theater or animation program plus 2+ years of practical experience, or 4+ years of practical experience including at least two projects with a theatrical release.
• A trained eye for detail on screen and the ability to put it into clear, specific words.
• Fluency in English. Proficiency in a second dubbing language (French, Italian, German, Spanish, Portuguese, Korean or Hindi) is a strong plus.
• Access to a good quality display and headphones for reviewing video and dialogue.
• Ability to engage reliably for at least 20 hours/week during weekdays.
• Strong written communication skills and the ability to explain creative judgments clearly.

About Cincinnatus LLC:Cincinnatus LLC is an enterprise staffing company that partners with leading technology companies to source and employ highly skilled professionals for contingent and contract-based opportunities. Cincinnatus serves as the employer of record for these engagements, providing W-2 employment, payroll, benefits, and compliance, while placing employees directly within client teams to work on high-impact initiatives.

Equal Employment Opportunity:Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic.