AI Model Quality Ops Manager

Meta; Seattle (WA); On-site; USD 123,000 - 179,000; Full time

Benefits offered by this job

Bonus

Equity

Benefits

Job summary

Meta is seeking a Product Operations Manager to join our Product Operations Foundations team and drive model quality across Meta surfaces. You will own end-to-end quality programs for AI-driven workflows and work with cross-functional partners to advance accuracy, drift prevention, and real-time observability.

This role involves setting strategy for LLM models and advising leadership on risks while shaping roadmaps and staffing for impactful AI tooling.

Qualifications

• Bachelor's degree in a directly related field or equivalent practical experience.
• 7+ years of experience in strategy, operations, consulting, or data analysis.
• Experience using data to influence product direction with SQL.
• Experience building or deploying AI/ML solutions in production workflows.
• Strong communication skills with cross-functional stakeholders and leadership.
• Ability to break down complex issues into actionable components.
• Experience designing AI workflows within enterprise data constraints.

Responsibilities

• Defines the technical direction for model maintenance (retraining cadences, drift mitigation, performance recovery) and evolution (new capabilities, architecture improvements).
• Provides cross-product context, defines what good looks like at the model level, and informs evaluation methodology.
• Ensures consistency across the portfolio and surfaces performance patterns to unblock evals leads.
• Defines what leadership needs to see, how model health should be measured, and thresholds for escalation.
• Provides thought partnership to evals managers on model health narratives and classification strategies.
• Drives alignment with cross-functional teams on tooling needs and investment decisions for AI model quality.

Skills

AI/ML strategy

Model quality

Cross-functional leadership

SQL

Data storytelling

Communication

Problem solving

Strategic planning

Enterprise workflows

Education

Bachelor's degree in a directly related field

Job description

Meta is seeking a Product Operations Manager to join our Product Operations Foundations team and drive model quality across Meta surfaces. You will own end-to-end quality programs for AI-driven workflows and work with cross-functional partners to advance accuracy, drift prevention, and real-time observability.

This role involves setting strategy for LLM models and advising leadership on risks while shaping roadmaps and staffing for impactful AI tooling.