ML Engineer, Core Experimentation & Insights

FDE Times

Bellevue (WA)

On-site

USD 180,000 - 240,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

OpenAI is seeking a Machine Learning Engineer to lead the technical direction for ML-powered experimentation and insights capabilities. You will build production systems that learn from privacy-protected product and experimentation data to generate evidence-backed insights and support decision-making, and help teams decide which ideas are worth testing live.

This end-to-end, 0-to-1 role spans ML modeling, retrieval and LLM systems, statistical methods, simulation, data and training pipelines,

Qualifications

  • Experience building ML-powered experimentation and insights systems.
  • Ability to design traceable, calibrated, and safe predictions.
  • Experience with privacy-preserving data processing.
  • Collaboration with product teams across multiple OpenAI domains.

Responsibilities

  • Set and execute the technical roadmap for Generative Insights and Predictive Experimentation, from early prototypes through production adoption.
  • Build cross-experiment learning systems that retrieve and synthesize historical experiments, detect recurring effects and segment behavior, reanalyze prior results when data or methods improve, and generate hypotheses with clear evidence and provenance.
  • Develop predictive models and simulation workflows, including simulation-based evaluation approaches, to estimate likely impact, affected segments, regression risk, and uncertainty before a full live experiment.
  • Create high-quality datasets and feature or retrieval pipelines from exposures, events, metrics, experiment metadata, and replay data, with strong lineage, freshness, privacy, and data-quality controls.
  • Establish rigorous evaluation through offline benchmarks, backtests, calibration, drift monitoring, prediction-to-outcome comparisons, and explicit failure or abstention behavior.
  • Turn models into durable product, API, and agent workflows that move from an insight to experiment design, approval-gated

Skills

Roadmap planning
Cross-experiment learning
Predictive modeling
Simulation workflows
Data pipelines
Privacy controls
Data quality controls
Offline evaluation
Experiment design

Job description

OpenAI is seeking a Machine Learning Engineer to lead the technical direction for ML-powered experimentation and insights capabilities. You will build production systems that learn from privacy-protected product and experimentation data to generate evidence-backed insights and support decision-making, and help teams decide which ideas are worth testing live.

This end-to-end, 0-to-1 role spans ML modeling, retrieval and LLM systems, statistical methods, simulation, data and training pipelines,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Machine Learning Engineer - Core Experimentation & Insights
Machine Learning Engineer - Core Experimentation & Insights

OpenAI, Inc. • Seattle (WA)

On-site
USD 437,000 - 485,000
Equity
Health insurance
401(k) retirement plan
+3
ML Engineer – Generative Experimentation & Insights
ML Engineer – Generative Experimentation & Insights

OpenAI, Inc. • Seattle (WA)

On-site
USD 437,000 - 485,000
ML Engineer, Experimentation & Insights Platform
ML Engineer, Experimentation & Insights Platform

OpenAI, Inc. • United States

Remote
USD 180,000 - 240,000
Machine Learning Engineer, Core Experimentation
Machine Learning Engineer, Core Experimentation

FDE Times • Bellevue (WA)

On-site
USD 180,000 - 240,000
Machine Learning Engineer, Core Experimentation
Machine Learning Engineer, Core Experimentation

OpenAI, Inc. • Seattle (WA)

On-site
USD 437,000 - 485,000
Remote AI Safety ML Engineer — Experiments & Evaluation
Remote AI Safety ML Engineer — Experiments & Evaluation

10a Labs • United States

Remote
USD 130,000 - 200,000
Fully remote (US-based)
Health benefits
Generous PTO
+2
ML Engineer: Implicit Signals & Production Evaluation
ML Engineer: Implicit Signals & Production Evaluation

OpenAI, Inc. • San Francisco (CA)

On-site
USD 180,000 - 260,000
ML Engineer - Lead I: AI Solutions & Prototyping
ML Engineer - Lead I: AI Solutions & Prototyping

Compunnel Inc. • Columbus (GA)

On-site
USD 90,000 - 120,000
ML Engineer — Core AI Evaluation Platform
ML Engineer — Core AI Evaluation Platform

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 140,000 - 210,000
Competitive compensation
Health and wellness benefits
Cutting-edge AI projects
+1
ML Engineer
ML Engineer

Blue Signal Search • United States

On-site
USD 120,000 - 180,000
Health insurance
Dental insurance
Life insurance
+1