Data Scientist - AI Safety & Model Evaluation

Meta; San Francisco (CA); Presencial; USD 177.000 - 247.000; Jornada completa

Descripción de la vacante

Meta's Safety team within Meta Superintelligence Labs (MSL) seeks a Data Scientist to build the analytical foundation for scalable safety as AI capabilities grow. You will quantify risks, design measurement systems, and partner with policy, legal, product, and engineering to guide interventions and risk mitigation.

You will implement scalable evaluation methodologies, develop dashboards and signals for real-time monitoring, and collaborate across cross-functional teams to translate complex risks

Formación

• Bachelor's degree in Computer Science, Mathematics, Statistics, Engineering or equivalent practical experience.
• Master's or Ph.D. degree in a quantitative field is preferred.
• 6+ years analytics experience (4+ years with a Ph.D.).
• Proficient with data querying languages (SQL), scripting (Python), and statistical software (R).
• Experience in frontier AI, Trust & Safety or Fraud/Risk domains is a plus.

Responsabilidades

• Measure abuse: build statistical telemetry and measurement frameworks to detect and monitor policy violations or emergent harms.
• Scale model evaluation: design scalable frameworks for evolving agentic model safety and risk assessment.
• Evaluate and optimize safeguards: assess offline/online performance of safeguards with human-in-the-loop and active learning.
• Design experiments and analyses: conduct controlled experiments and rollouts to evaluate policy or risk changes.
• Build intelligence and reporting: create signals, pipelines, dashboards for real-time safety monitoring and interventions.

Conocimientos

Statistical analysis

Causal inference

Experimental design

Cross-functional collaboration

Educación

Bachelor's degree in CS/Math/Statistics/Engineering or equivalent practical experience

Master's or Ph.D. in a quantitative field

Herramientas

SQL

Python

R

Descripción del empleo

Meta's Safety team within Meta Superintelligence Labs (MSL) seeks a Data Scientist to build the analytical foundation for scalable safety as AI capabilities grow. You will quantify risks, design measurement systems, and partner with policy, legal, product, and engineering to guide interventions and risk mitigation.

You will implement scalable evaluation methodologies, develop dashboards and signals for real-time monitoring, and collaborate across cross-functional teams to translate complex risks