Remote Producer for AI Evaluation & Production Benchmarks

YO AI Labs; San Francisco (CA); Remote; USD 50,000 - 90,000; Full time

Job summary

YO AI Labs is seeking experienced Producers across film, television, digital, or live events to support an AI evaluation project. You will create realistic industry scenarios, evaluate outputs, and develop benchmarks.

No prior AI experience is required, and work is remote. Key responsibilities include crafting budgets, call sheets, and schedules; producing evaluation rubrics; and validating tasks for realism and relevance.

Qualifications

• 5+ years of professional production experience.
• Hands-on budgets, call sheets, contracts, schedules, vendors, and crew.
• Strong understanding of production workflows and industry best practices.
• Excellent written communication and analytical judgment.
• Experience creating rubrics or evaluation frameworks is a plus.
• Ability to work independently in a remote environment.

Responsibilities

• Create realistic production evaluation tasks covering budgets, schedules, contracts, crew, and vendors.
• Develop and curate production artifacts such as call sheets, budgets, and delivery schedules.
• Define correct solutions for complex, multi-constraint production scenarios.
• Create detailed evaluation rubrics to assess production decisions and judgment.
• Review and validate tasks for accuracy, realism, and industry relevance.
• Document workflows and incorporate reviewer feedback.

Skills

Production Mastery

Production Documentation

Multi-Constraint Judgment

Vendor & Crew Coordination

Budget & Schedule Management

Film/TV/Digital/Live Production

Analytical Decision-Making

Technical Writing

Job description

YO AI Labs is seeking experienced Producers across film, television, digital, or live events to support an AI evaluation project. You will create realistic industry scenarios, evaluate outputs, and develop benchmarks.

No prior AI experience is required, and work is remote. Key responsibilities include crafting budgets, call sheets, and schedules; producing evaluation rubrics; and validating tasks for realism and relevance.