Experimentation & Causal Inference Lead

ByLabs; Seattle (WA); On-site; USD 150,000 - 230,000; Full time

Job summary

ByLabs in Seattle seeks a Senior Data Scientist specializing in Experimentation & Causal Inference to own the statistical framework of our experimentation program. You will design, validate, and improve methods that ensure trustworthy interpretations of results, while partners with product and platform teams for production-ready implementations.

You will leverage CUPED, SRM checks, and variance-reduction techniques to accelerate insights, with emphasis on AI-assisted tooling and

Qualifications

• MS or PhD in Statistics, Biostatistics, Econometrics, CS, or related quantitative field.
• 3+ years designing online controlled experiments at a tech company with meaningful user scale.
• Solid foundations in hypothesis testing, power analysis, multiple testing correction, and sequential testing.

Responsibilities

• Design and maintain automated anomaly detection for live experiments (SRM checks, traffic split validation).
• Define alert thresholds and circuit-breaking criteria to protect experiments.
• Define and validate guardrail metrics for experiment health and interpretability.
• Implement CUPED and covariate adjustment to reduce variance and improve detection power.
• Translate methods into production-ready specifications, validation scripts, and self-serve tooling.

Skills

Statistical analysis

Experiment design

Communication

Bilingual communication English/中文 (英语

AI tooling proficiency

Education

MS or PhD in Statistics / Econometrics / related quantitative field

Tools

Python

SQL

Claude Code/OpenClaw

Job description

ByLabs in Seattle seeks a Senior Data Scientist specializing in Experimentation & Causal Inference to own the statistical framework of our experimentation program. You will design, validate, and improve methods that ensure trustworthy interpretations of results, while partners with product and platform teams for production-ready implementations.

You will leverage CUPED, SRM checks, and variance-reduction techniques to accelerate insights, with emphasis on AI-assisted tooling and