Senior Data Scientist, Safety & Model Evaluation

Meta; Menlo Park (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Meta invites a seasoned Data Scientist to join the Safety team within MSL. You will turn complex risk signals into measurable systems across model evaluations and online monitoring, collaborating with engineering, research, product, policy, and legal to design robust measurement and mitigation strategies that balance user safety and product experience.

You will build telemetry, dashboards, and experiments to quantify harms, evaluate safeguards with human-in-the-loop and active learning, and

Qualifications

• Bachelor's degree in CS/CE or equivalent practical experience.
• 12+ years in product data science, analytics, or quantitative research with leadership of complex projects.
• 12+ years of SQL and Python or R; experience with large-scale data analysis.
• Expertise in predictive modeling, causal inference, experimentation design, and time series forecasting in product contexts.
• Experience influencing product strategy with data-driven narratives across cross-functional teams.
• Experience establishing analytical standards and data infrastructure across an organization.

Responsibilities

• Measure abuse: build statistical telemetry and measurement frameworks to detect and monitor policy violations or emergent harms
• Scale model evaluation: design a scalable framework adapting to evolving agentic model capabilities and safety landscape, grounded in statistics
• Evaluate and optimize safeguards: scale offline and online performance evaluation of our safeguards using human-in-the-loop and active learning
• Design experiments and analyses: Conduct controlled experiments and rollouts to evaluate the impact of policy or risk definition changes and safety mitigations
• Build intelligence and reporting: build signals, pipelines, dashboards to enable real-time monitoring driving interventions and safety roadmaps

Skills

SQL

Python

R

Statistical methods

Data storytelling

Cross-functional collaboration

Executive communication

Education

Bachelor's degree in CS/CE or equivalent practical experience

Advanced degree (MS/PhD) in quantitative field

Tools

Statistical software

Job description

Meta invites a seasoned Data Scientist to join the Safety team within MSL. You will turn complex risk signals into measurable systems across model evaluations and online monitoring, collaborating with engineering, research, product, policy, and legal to design robust measurement and mitigation strategies that balance user safety and product experience.

You will build telemetry, dashboards, and experiments to quantify harms, evaluate safeguards with human-in-the-loop and active learning, and