Data Scientist, Core Experimentation

Rebash; Bellevue (WA); Hybrid; USD 293,000 - 325,000; Full time

Job summary

OpenAI in Bellevue is hiring a Staff-level Data Scientist to lead the evolution of our core experimentation platform. You will improve statistical rigor, reliability, and practical usability across teams and scale, addressing deep issues like variance reduction, bias mitigation, and sequential testing.

You will craft robust analytical systems in Python, collaborate with engineers, and mentor other data scientists while shaping best practices for governance and interpretation of results in a

Qualifications

• Experience building, scaling, or operating experimentation platforms at a large technology company.
• Deep expertise in statistics, causal inference, and online experimentation methodology.
• Strong coding and systems skills in Python and Spark.

Responsibilities

• Drive the statistical direction and technical strategy for OpenAI’s experimentation platform.
• Design and improve experimentation methodologies used across product and research teams.
• Lead investigations into complex experimentation anomalies and measurement failures.
• Mentor other data scientists and raising the overall technical bar for experimentation and causal inference.

Skills

Statistics

Causal inference

Experimentation methodology

Python

Tools

Python

Spark

Job description

# Data Scientist, Core ExperimentationOpenairemotefull timeSeattleApply## DescriptionAbout the TeamThe Statsig team at OpenAI builds and operates the experimentation platform that powers product development, measurement, and decision-making across the company. We partner closely with product, engineering, and infrastructure teams to ensure experiments are trustworthy, statistically rigorous, and scalable to the needs of frontier AI products.Our mission is to help teams make better decisions through reliable experimentation. We care deeply about statistical correctness, pragmatic solutions, and building systems that researchers and engineers can trust at massive scale. The team operates at the intersection of experimentation methodology, data infrastructure, causal inference, and product analytics.We are looking for experienced experimentation experts who want to shape the future of experimentation in the AI era.About the RoleWe are hiring a Staff-level Data Scientist to help lead the evolution of OpenAI’s core experimentation platform. This role is focused on improving the statistical rigor, reliability, and practical usability of experimentation across the company.You’ll work on some of the hardest problems in online experimentation: sample ratio mismatch detection, variance reduction, bias mitigation, metric design, triggered analysis, heterogeneous treatment effects, sequential testing, and experimentation in complex ML systems. You’ll also help translate advanced statistical concepts into pragmatic systems and product experiences that teams can actually use.This is a highly technical individual contributor role with significant influence across methodology, platform architecture, and experimentation best practices. The ideal candidate combines deep statistical expertise with strong systems intuition and hands-on experience building or operating experimentation platforms at scale.In this role, you will:Drive the statistical direction and technical strategy for OpenAI’s experimentation platformDesign and improve experimentation methodologies used across product and research teamsBuild pragmatic solutions to real-world experimentation challenges, balancing rigor with operational simplicityImprove the reliability and trustworthiness of experiment results, including detection and prevention of bias, logging issues, and data quality failuresDevelopscalable analytical systems and pipelines in Python and distributed compute environmentsPartner with engineers and product teams to improve experiment design, metric quality, and decision-making practicesLead investigations into complex experimentation anomalies and measurement failuresEstablish best practices for experimentation governance, interpretation, and statistical correctnessMentor other data scientists and raising the overall technical bar for experimentation and causal inferenceYou might thrive in this role if you have:Experience building, scaling, or operating experimentation platforms at a large technology companyDeep expertise in statistics, causal inference, and online experimentation methodologyStrong understanding of practical experimentation challenges in production systemsExperience with areas such as variance reduction, CUPED, sequential testing, SRM detection, metric design, or heterogeneous effectsStrong coding and systems skills in Python and large-scale data processing frameworks (e.g. Spark)Experience designing analytical data models and scalable experimentation pipelinesAbility to communicate complex statistical concepts clearly to technical and non-technical audiencesTrack record of influencing technical strategy through hands-on technical leadershipExperience in large-scale product experimentation, ML experimentation, ranking systems, marketplace systems, or similar high-scale experimentation domains is highly valuedWorkplace & LocationThis role is based in Bellevue. We use a hybrid work model and value in-person collaboration for technical design, iteration, and cross-functional partnership.Compensation Range : $293K - $325K USD