Product Content Engineer

Instagram; New York (NY); On-site; USD 162,000 - 227,000; Full time

Benefits offered by this job

Bonus

Equity

Benefits

Job summary

Instagram is seeking a Product Content Engineer to define content quality standards and evaluate AI models across its products. The role includes designing evaluation frameworks and collaborating with product, engineering, and design teams to ensure AI behaviors align with user expectations.

The ideal candidate has over five years of collaborative experience and a background in generative AI products, along with strong data analysis skills. Competencies in Python and SQL are preferred, and the position offers a competitive salary package with bonuses and equity.

Qualifications

• 5+ years of experience collaborating with product, engineering, design, and user research teams.
• 1+ years working with generative AI products.
• Experience designing and implementing evaluation frameworks for AI systems.
• Demonstrated data analysis skills to produce actionable insights.
• Proven track record in cross-functional collaboration.

Responsibilities

• Define content quality standards for evaluating AI models.
• Design evaluation frameworks integrating qualitative and quantitative signals.
• Work with cross-functional teams to align AI behaviors with user expectations.
• Develop processes to track content quality and model performance.

Skills

Collaborative teamwork

Data analysis

Cross-functional collaboration

Critical thinking

AI evaluation

Tools

Python

SQL

Job description

Product Content Engineer Responsibilities:

• Define content quality standards and use them to systematically evaluate how AI models are performing across our products and content experiences
• Design golden sets, taxonomies, and guidelines that enable consistent, repeatable content quality assessments
• Build repeatable workflows for collecting, annotating, and analyzing AI outputs so evaluations can run efficiently as models evolve
• Evaluate successive model releases through structured comparison, documenting what improved, what regressed, and what to prioritize next
• Design evaluation frameworks that integrate qualitative and quantitative signals to measure dimensions like user trust, content depth, and topical relevance
• Develop processes to track content quality and model performance over time and flag regressions
• Synthesize evaluation results into structured error patterns and concrete recommendations that engineering and product teams can act on
• Work cross‑functionally with engineers, data scientists, product managers, and content strategists to align AI behaviors with real‑world user expectations

Minimum Qualifications:

• 5+ years of experience working collaboratively with product, engineering, design, and user research teams
• 1+ years working with generative AI products, AI evaluation, prompt engineering, annotation, and/or content labeling and analysis
• Experience designing and implementing evaluation frameworks, annotation guidelines, or quality rubrics for AI/ML systems
• Demonstrated data analysis skills, with experience exploring data, identifying patterns, and producing actionable insights
• Experience building new products or platform/ecosystem products
• Critical thinking, experience leading data‑driven analyses to inform product or content decisions, and experience communicating to executive leadership
• Proven track record of cross‑functional collaboration and delivering results in environments with evolving requirements and competing priorities

Preferred Qualifications:

• Background in content strategy, information quality, or trust and safety
• Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)
• Familiarity with AI evaluation methods such as human eval, model‑as‑judge, A/B testing, or red‑teaming
• Experience building dashboards, scripts, or workflows that codify evaluation metrics
• Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies
• Experience with Python, SQL, or other tools for data analysis and evaluation automation
• Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)

Meta is proud to be an Equal Employment Opportunity and affirmative action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, transgender status, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment. Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need assistance or accommodations due to a disability, please let us know at [e-mail].

$162,000/year to $227,000/year + bonus + equity + benefits