Media & Information AI Training Specialist — Task Creation & Model Evaluation

BAM Ventures; New York (NY); On-site; USD 60,000 - 90,000; Full time

Benefits offered by this job

Professional development

Flexible working environment

Challenging AI projects

Job summary

Rise Data Labs seeks a Media & Information AI Training Specialist to craft realistic media tasks and rubrics for AI training in journalism, editing, and video production. You will draft and source reference materials, then grade AI outputs against your rubric to ensure publication-ready quality.

Preferred candidates bring hands-on journalism, editing, writing, or video production experience and comfort evaluating professional-grade work to benchmark AI performance.

Qualifications

• Journalist or editor experience preferred.
• Experience in writing, producing, or directing media content.
• Familiarity with video production workflows and editorial standards.

Responsibilities

• Create realistic media tasks and rubrics based on professional experience.
• Grade AI-generated deliverables against rubrics and standards.
• Provide reference materials like source documents and style guides.
• Join calibration sessions to ensure consistent scoring across benchmarks.
• Collaborate with experts to refine benchmarks and tasks.

Skills

Journalist

Editor

Writer

Producer

Director

Video Editor

Job description

About Rise Data Labs

Rise Data Labs is a leading AI training and data annotation company that specializes in creating high-quality training data for artificial intelligence systems. We work with top AI companies and research institutions to improve machine learning models through expert human annotation and validation. Our team of domain specialists, subject matter experts, and quality assurance professionals work across various fields including journalism, editorial, and video/film production. We pride ourselves on our attention to detail, domain expertise, and commitment to delivering accurate, high-quality training data.

Job Overview

As a Media & Information AI Training Specialist at Rise Data Labs, you will play a crucial role in training and enhancing AI models specifically tailored for journalism, editorial, and video/film production work. This role goes beyond traditional annotation and labeling — you'll author realistic, economically valuable media tasks and rubrics based on your own professional experience, then grade AI-generated deliverables against them.

What You'll Do

• Create realistic work scenarios based on your own professional experience — e.g., drafting or editing an article, fact-checking and sourcing, writing a script or shot list, reviewing a rough cut or storyboard
• Supply the kinds of reference materials you'd normally work from (source documents, style guides, scripts, production notes)
• Write detailed rubrics specifying exactly what a correct, publication‑ready or production‑ready deliverable requires — accurate sourcing, correct style/format, sound editorial or production judgment
• Grade AI-generated deliverables (often written pieces, scripts, or production documents) against your rubric
• Join calibration sessions with other experts to ensure consistent scoring across the benchmark

Preferred Qualifications

• Prior hands‑on experience as a Journalist, Editor, Writer, Producer, Director, or Video Editor
• Comfort reviewing detailed written or production work product against professional standards
• Prior experience with AI model training, evaluation, or benchmark development is a plus

What We Offer

At Rise Data Labs, we value our contributors and strive to create a supportive, flexible working environment. We offer opportunities for professional development in the AI field and the chance to work on innovative projects that directly shape the future of AI in media, journalism, and video production.