Staff Engineer, Experimentation Platform & Adaptive ML

LaunchDarkly Group; United States; Remote; USD 183,000 - 295,000; Full time

Benefits offered by this job

RSUs

Health insurance

Dental insurance

Vision insurance

Mental health benefits

Job summary

LaunchDarkly is seeking a Staff Engineer on the Experimentation team to design and build the statistical engine and warehouse-native analytics that power data-driven product decisions. You will own end-to-end systems, mentor engineers, and help shape platform direction.

You’ll implement hypothesis testing, sequential analysis, and variance reduction across Snowflake, Databricks, Redshift, and BigQuery integrations, while leading adaptive experimentation techniques such as contextual bandits and

Qualifications

• 10+ years building large-scale experimentation platforms, statistical analysis systems, or data-intensive backend services.
• Applied-statistics knowledge: hypothesis testing, sequential analysis, variance reduction (CUPED), power analysis, experiment design. Comfortable with frequentist vs. Bayesian trade-offs.
• Experience with adaptive experimentation ML — contextual bandits, Thompson sampling, Bayesian optimization, or RL-based allocation.

Responsibilities

• Build the experimentation statistical engine — hypothesis testing, sequential analysis, variance reduction (CUPED, Winsorization), power analysis.
• Design warehouse-native experimentation that runs analysis inside customer warehouses (Snowflake, Databricks, Redshift, BigQuery). Build modular, warehouse-agnostic abstractions for rapid new backend support.
• Lead adaptive experimentation — contextual bandit systems, Bayesian optimization, automated allocation beyond simple A/B tests.
• Drive the platform roadmap with product, design, and data science. Shape what we build, not just how.
• Collaborate cross-functionally with Warehouse Integrations, SDK, Platform, and Data Science teams.
• Mentor engineers and raise the team’s bar for statistical rigor and system design.
• Own operational excellence — monitoring, observability, incident response, on-call. Robust telemetry and alerting.

Skills

Experimentation platforms

Statistical analysis

Adaptive experimentation ML

Go/Python

Cloud environments

Technical leadership

Data pipelines

Tools

Snowflake

Databricks

Redshift

BigQuery

Job description

LaunchDarkly is seeking a Staff Engineer on the Experimentation team to design and build the statistical engine and warehouse-native analytics that power data-driven product decisions. You will own end-to-end systems, mentor engineers, and help shape platform direction.

You’ll implement hypothesis testing, sequential analysis, and variance reduction across Snowflake, Databricks, Redshift, and BigQuery integrations, while leading adaptive experimentation techniques such as contextual bandits and