Senior Production Specialist for AI Evaluation

YO AI Labs; Austin (TX); Remote; USD 30,000 - 70,000; Part time

Benefits offered by this job

Remote-friendly

Fast onboarding (24–48 hours)

Job summary

YO AI Labs is seeking experienced Producers across film, television, digital, or live events to support an AI evaluation project in a fully remote capacity. You will craft realistic industry scenarios, evaluate AI outputs, and develop benchmarks that reflect real-world production workflows.

No prior AI experience is required, and candidates should bring strong project management, budgets, schedules, contracts, crew, and vendor coordination skills to the table, delivering clear evaluation rubrics

Qualifications

• 5+ years of professional production experience.
• Hands-on with budgets, call sheets, contracts, schedules, vendors, and crew.
• Strong understanding of production workflows and best practices.
• Excellent written communication and analytical judgment.
• Experience creating rubrics or evaluation frameworks is a plus.
• Ability to work independently in a remote environment.

Responsibilities

• Create realistic production evaluation tasks covering budgets, schedules, contracts, crew, and vendors.
• Develop and curate production artifacts such as call sheets, budgets, and delivery schedules.
• Define correct solutions for complex, multi-constraint production scenarios.
• Create detailed evaluation rubrics to assess production decisions and judgment.
• Review and validate tasks for accuracy, realism, and industry relevance.
• Document workflows and incorporate reviewer feedback.

Skills

Production mastery

Documentation

Multi-constraint judgment

Vendor coordination

Budget & schedule

Film/TV/digital/live

Analytical thinking

Technical writing

Job description

YO AI Labs is seeking experienced Producers across film, television, digital, or live events to support an AI evaluation project in a fully remote capacity. You will craft realistic industry scenarios, evaluate AI outputs, and develop benchmarks that reflect real-world production workflows.

No prior AI experience is required, and candidates should bring strong project management, budgets, schedules, contracts, crew, and vendor coordination skills to the table, delivering clear evaluation rubrics