Content Engineer - AI Quality and Product Experience (Equity)

Meta; New York (NY); On-site; USD 162,000 - 227,000; Full time

Benefits offered by this job

Bonus

Equity

Benefits

Job summary

Meta's Content Engineering team within Meta Superintelligence Labs seeks a Content Engineer to define quality standards for AI product capabilities, build evaluation infra, and drive alignment between research, engineering, product, and policy.

You will design rubrics, manage annotator teams, run large-scale evals, and lead fast iteration across prompts and system behavior to deliver reliable, user-friendly AI experiences.

Qualifications

• Bachelor's degree or equivalent; 5+ years in digital content strategy, UX, or related fields.
• Experience designing and running human evaluation pipelines at scale.
• Experience translating ambiguous feedback into structured categories.
• Experience defining quality benchmarks for product capabilities.
• Experience running structured software testing/QA with fast feedback to engineering.

Responsibilities

• Define quality standards for AI product capabilities and build guidelines.
• Own the full human evaluation pipeline and analyze results.
• Design and run large-scale evals to track quality over time.
• Lead testing programs and triage results for rapid iteration.
• Coordinate across product, engineering, research, and design on quality.

Skills

Prompt engineering

Quality frameworks

Human evaluation design

Cross-functional leadership

Agentic workflows

Education

Bachelor's degree or equivalent

Tools

LLM-based development tools

Annotation platforms

Prototyping environments

Job description

Meta's Content Engineering team within Meta Superintelligence Labs seeks a Content Engineer to define quality standards for AI product capabilities, build evaluation infra, and drive alignment between research, engineering, product, and policy.

You will design rubrics, manage annotator teams, run large-scale evals, and lead fast iteration across prompts and system behavior to deliver reliable, user-friendly AI experiences.