Product Content Engineer

Meta Careers; San Francisco (CA); On-site; USD 131,000 - 190,000; Full time

Job summary

Meta seeks a Product Content Engineer to own evaluation rubrics and human assessments for image and video generation. You will design rubrics, run evaluation rounds, and produce writeups that translate subjective quality into measurable signals guiding model behavior and launches.

You will curate test prompts and golden sets, calibrate with raters and vendors, and help bridge human judgment with automated metrics in a fast-paced environment.

Qualifications

• Hands-on video production experience and craft vocabulary to describe quality failures precisely.
• Experience creating or contributing to evaluation rubrics or quality guidelines for video or image content.
• Experience producing or evaluating short-form video and emerging video formats.
• Ability to document judgment logic into reusable scalable frameworks.

Responsibilities

• Build and maintain evaluation rubrics for image and video generation quality, including definitions and guidelines.
• Execute human evaluation rounds on model outputs and produce actionable writeups.
• Construct and curate prompt sets and golden sets to stress-test model capabilities.
• Calibrate with raters and vendor teams to ensure reliable assessments.
• Support translation of human judgment into automated measurement and validate automated scores against human ground truth.

Skills

Video production

Editorial standards

Cross-functional collaboration

Quantitative insights

Independent work

Education

Bachelor's degree in a related field

Tools

Annotation platforms

Eval tooling

Job description

Product Content Engineering is a horizontal function supporting initiatives across Instagram and Meta AI, and is seeking a content engineer to join the team. We partner closely with product, research and modeling teams to solve problems with content-driven solutions, set standards of quality, and define what “good” looks like for generative media experiences.This position is focused on model training for image and video generation capabilities. You will own the human evaluation layer that tells our models what quality means, designing the rubrics, running the eval rounds, and turning subjective creative judgment into reproducible, measurable signals that directly shape model behavior and launch decisions.This position requires hands-on video production experience and the craft vocabulary to describe media quality precisely. The work involves applying rubrics consistently across high volumes of generated clips, distinguishing prompt-following failures from model-quality failures, documenting observations clearly, and writing and refining the rater guidelines themselves.Product Content Engineer Responsibilities:Build and maintain evaluation rubrics for image and video generation quality, including dimension definitions, rating scales and annotator guidelinesExecute human evaluation rounds on model output, side-by-sides, absolute scoring and prompt-adherence checks, and produce clear, actionable writeupsConstruct and curate prompt sets and golden sets that stress-test specific model capabilities and failure modesCalibrate with fellow raters and vendor teamshelp drive inter-rater reliabilityPartner with research and modeling teams so eval findings translate into training and post-training signalSupport the transition of human judgment into automated measurement and help validate automated scores against human ground truthTrack quality trends across model versions and flag regressions earlyDeliver high-quality evaluation work on model and launch timelines in a fast-paced, dynamic environmentMinimum Qualifications:6+ years of experience in video production, content strategy, editorial standards, media evaluation or relevant fieldsHands-on video production experience, including shooting, editing, post and/or motion work, with the craft vocabulary to describe quality failures preciselyExperience creating or substantially contributing to evaluation rubrics or quality guidelines for video or image contentExperience producing or evaluating short-form video and emerging video formatsExperience applying editorial judgment, plus the ability to document judgment logic into reusable frameworks that scale across teamsExperience leveraging quantitative insights to inform content and quality decisionsExperience collaborating with cross-functional teams (product, engineering, design, research, analytics)Experience working independently and navigating ambiguity in fast-paced environmentsBachelor's degree in a directly related field, or equivalent practical experiencePreferred Qualifications:Experience evaluating generative media output (text-to-video, image-to-video, video-to-video, text-to-image)Background in film, television, OTT, commercial or VFX productionFamiliarity with generative media tooling and prompt engineering for media generationExperience with annotation platforms or eval toolingExperience with product launches in ambiguous or zero-to-one environmentsDemonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologiesAbout Meta:Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at [e-mail].$131,000/year to $190,000/year + bonus + equity + benefitsIndividual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.