Generative Media Evaluation Engineer

Instagram LLC; Los Angeles (CA); On-site; USD 131,000 - 190,000; Full time

Job summary

Instagram LLC is seeking a Product Content Engineer to lead evaluation for image and video generation quality. You will own human evaluation rubrics, design prompts, run evaluation rounds, and translate findings into model training signals.

The role requires hands-on video production experience and the ability to document judgment into scalable guidelines for cross-functional teams. Strong collaboration with product, research, and analytics is essential.

Qualifications

• 6+ years of experience in video production, content strategy or media evaluation.
• Hands-on video production including shooting, editing, post and motion work.
• Experience creating evaluation rubrics or quality guidelines for video or image content.

Responsibilities

• Build and maintain evaluation rubrics for image and video generation quality.
• Execute human evaluation rounds and produce actionable writeups.
• Construct and curate prompt sets and golden sets to stress-test model capabilities.
• Calibrate with raters and vendor teams to drive inter-rater reliability.
• Partner with research and modeling teams to translate eval findings into signals

Skills

Video production

Content strategy

Editorial standards

Media evaluation

Quantitative insights

Cross-functional collaboration

Ambiguity navigation

Education

Bachelor's degree (or equivalent)

Job description

Instagram LLC is seeking a Product Content Engineer to lead evaluation for image and video generation quality. You will own human evaluation rubrics, design prompts, run evaluation rounds, and translate findings into model training signals.

The role requires hands-on video production experience and the ability to document judgment into scalable guidelines for cross-functional teams. Strong collaboration with product, research, and analytics is essential.