Remote Producer for AI Evaluation & Production Benchmarks

YO IT Consulting; Dallas (TX); Remote; USD 83,000 - 165,000; Part time

Job summary

YO IT Consulting is seeking an experienced Producer for an AI evaluation project spanning film, TV, digital, and live events. You will craft realistic production scenarios, evaluate AI outputs, and develop benchmarks to measure performance and realism.

The role emphasizes production expertise, detail-oriented rubric design, and independent work in a remote setting. This contractor position offers output-based compensation and rapid onboarding.

Qualifications

• 5+ years of professional production experience.
• Hands-on experience with budgets, call sheets, contracts, schedules, vendors, and crew.
• Strong understanding of production workflows and industry best practices.
• Excellent written communication and analytical judgment.
• Experience creating rubrics or evaluation frameworks is a plus.
• Ability to work independently in a remote environment.

Responsibilities

• Create realistic production evaluation tasks covering budgets, schedules, contracts, crew, and vendors.
• Develop and curate production artifacts such as call sheets, budgets, and delivery schedules.
• Define correct solutions for complex, multi-constraint production scenarios.
• Create detailed evaluation rubrics to assess production decisions and judgment.
• Review and validate tasks for accuracy, realism, and industry relevance.
• Document workflows and incorporate reviewer feedback.

Skills

Production Mastery

Production Documentation

Multi-Constraint Judgment

Vendor & Crew Coordination

Budget & Schedule Management

Film/TV/Digital/Live Production

Analytical Decision-Making

Technical Writing

Job description

YO IT Consulting is seeking an experienced Producer for an AI evaluation project spanning film, TV, digital, and live events. You will craft realistic production scenarios, evaluate AI outputs, and develop benchmarks to measure performance and realism.

The role emphasizes production expertise, detail-oriented rubric design, and independent work in a remote setting. This contractor position offers output-based compensation and rapid onboarding.