Remote Film & TV AI Evaluation Specialist

OpenTrain AI, Inc.; United States; Hybrid; USD 34,000 - 55,000; Part time

Benefits offered by this job

Remote work

Part-time scheduling

Competitive compensation

Job summary

OpenTrain AI is seeking a Film and Television AI Evaluation Expert to craft challenging prompts and evaluate AI responses for accuracy and nuance. You will focus on film, television, streaming, and entertainment history while identifying knowledge gaps and helping build benchmark datasets.

This is a part-time contractor role in the United States with 20+ hours per week. Master's degree or higher in Film Studies or related field is required, plus at least three years of relevant professional

Qualifications

• Master's degree or higher required.
• 3+ years of professional experience in entertainment journalism, film or television criticism, entertainment media, content creation, research, or analysis.
• Excellent written English and strong research/analytical skills.

Responsibilities

• Create advanced prompts about films, television series, streaming, actors, directors, genres, awards, franchises, and entertainment history.
• Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
• Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
• Develop benchmark datasets and adversarial test cases.
• Provide evidence-based feedback supported by reliable references.
• Compare multiple AI responses, explain why answers are correct or incorrect, and propose improved prompts.

Skills

Research and analytical judgment

Excellent written English

Attention to detail

Education

Master's degree in Film Studies or related discipline

Job description

The Work

You will help improve AI systems by testing what they know about film, television, streaming, and entertainment history. You will create difficult questions, compare AI answers, and explain which responses are accurate, incomplete, outdated, or misleading.

Your work will support benchmark datasets, which are collections of test examples used to measure AI quality. You will also create adversarial test cases designed to reveal weaknesses, and work with AI researchers to identify gaps in the models' knowledge.

• Create advanced prompts about films, television series, actors, directors, genres, awards, franchises, streaming platforms, and entertainment history.
• Rate AI-generated responses for factual accuracy, reasoning, completeness, and nuance.
• Find hallucinations, logical inconsistencies, outdated information, and edge cases.
• Compare multiple AI responses and explain why each answer is correct or incorrect.
• Provide evidence-based feedback with reliable references and suggest improved prompts.
• Develop benchmark datasets and adversarial tests for AI evaluation.

What It Pays And Takes

The role is structured as contract, part-time work. It is open to candidates in the United States and requires at least 20 hours per week.

• Location: Open to candidates in the United States.
• Time: 20 or more hours per week.
• Work type: Contract and part-time.
• Education: A master's degree or higher is required. Film Studies, Television Studies, Media Studies, Journalism, or a related field is preferred.
• Experience: At least three years in entertainment journalism, film or television criticism, entertainment media, content creation, research, or analysis.
• Knowledge: Strong knowledge of movies and television, including films, series, actors, directors, genres, franchises, awards, streaming platforms, and major developments.
• Skills: Excellent written English, research, analysis, and attention to detail.
• Helpful background: Experience with large language models, generative AI, prompt engineering, or AI evaluation; published research, industry recognition, or teaching experience; and the ability to work independently and provide objective, evidence-backed reviews.

How It Works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI Training Work

AI training is the human work behind systems that generate and understand text. People write examples, review model answers, and explain what makes a response useful and accurate, helping AI systems improve.