Senior Algorithm Validation Scientist

Whoop; Boston (MA); On-site; USD 140,000 - 200,000; Full time

Job summary

WHOOP is seeking a Senior Algorithm Validation Scientist to join the Sensor Intelligence organization and help ensure our physiological sensing algorithms deliver accurate, equitable, and scientifically validated performance for our members.

You will design rigorous analyses and validation studies that evaluate algorithm performance throughout development and after deployment, translating complex real-world data into evidence that informs product decisions and improvements.

Qualifications

• Advanced degree in statistics or related quantitative field required.
• 3+ years applying statistical methods to complex datasets, preferably in health/wearables.
• Strong foundation in inference, testing, regression, and experimental design; causal and equivalence analyses are a plus.
• Proficiency with Python or R and SQL; experience with large-scale data environments.
• Experience with time-series or longitudinal data and validating ML/signal processing algorithms.
• Familiarity with fairness/parity analyses and communicating complex statistics clearly.

Responsibilities

• Design and execute rigorous statistical analyses and validation studies to evaluate accuracy, precision, reliability, robustness, and generalizability of physiological sensing algorithms against reference-standard measurements.
• Develop equivalence and non-inferiority analyses for hardware revisions, manufacturing changes, algorithm updates, and other changes that may affect the member experience, defining appropriate performance metrics, confidence intervals, hypothesis tests, and uncertainty estimates.
• Evaluate algorithm performance across demographic groups, physiological characteristics, environmental conditions, and behavioral contexts to identify performance differences, edge cases, and opportunities to improve algorithm quality and equity.
• Analyze experimental and observational production data to understand real-world algorithm behavior and draw defensible conclusions, applying approaches such as within-subject designs, difference-in-differences, matching, and other methods to account for confounding factors.
• Develop reproducible analysis workflows and automated validation processes that enable analyses to be consistently repeated across new cohorts, hardware revisions, and algorithm releases.
• Partner with Algorithm Scientists, Machine Learning Engineers, Product Managers, Clinical Scientists, and Software Engineers to design validation protocols, establish statistical best practices, communicate findings to technical and non-technical audiences, and translate evidence into product improvements.

Skills

Statistical inference

Hypothesis testing

Experimental design

Uncertainty quantification

Causal inference

Equivalence testing

Non-inferiority analysis

Data analysis (Python/R)

SQL

Time-series analysis

Education

Advanced degree in Statistics or related field

Tools

Python

R

SQL

Job description

At WHOOP, we’re on a mission to unlock and inspire performance for life. WHOOP empowers members to perform at a higher level through a deeper understanding of their bodies and daily lives.

WHOOP is seeking an Senior Algorithm Validation Scientist to join the Sensor Intelligence organization and help ensure our physiological sensing algorithms deliver accurate, equitable, and scientifically validated performance for our members. In this role, you will design rigorous statistical analyses and validation studies that evaluate algorithm performance throughout development and after deployment, translating complex real-world data into evidence that informs algorithm quality and product decisions. You’ll partner closely with scientists, engineers, and product teams to understand algorithm behavior, quantify uncertainty, identify opportunities for improvement, and help ensure members receive accurate and trustworthy insights.

RESPONSIBILITIES

• Design and execute rigorous statistical analyses and validation studies to evaluate the accuracy, precision, reliability, robustness, and generalizability of physiological sensing algorithms against reference-standard measurements

• Develop equivalence and non-inferiority analyses for hardware revisions, manufacturing changes, algorithm updates, and other changes that may affect the member experience, defining appropriate performance metrics, confidence intervals, hypothesis tests, and uncertainty estimates

• Evaluate algorithm performance across demographic groups, physiological characteristics, environmental conditions, and behavioral contexts to identify performance differences, edge cases, and opportunities to improve algorithm quality and equity

• Analyze experimental and observational production data to understand real-world algorithm behavior and draw defensible conclusions, applying approaches such as within-subject designs, difference-in-differences, matching, and other methods to account for confounding factors

• Develop reproducible analysis workflows and automated validation processes that enable analyses to be consistently repeated across new cohorts, hardware revisions, and algorithm releases

• Partner with Algorithm Scientists, Machine Learning Engineers, Product Managers, Clinical Scientists, and Software Engineers to design validation protocols, establish statistical best practices, communicate findings to technical and non-technical audiences, and translate evidence into product improvements

QUALIFICATIONS

• Advanced degree in Statistics, Biostatistics, Data Science, Applied Mathematics, Biomedical Engineering, Epidemiology, or a related quantitative discipline, or equivalent practical experience

• 3+ years of experience applying statistical methods to complex experimental or observational datasets, ideally within healthcare, medical devices, wearables, digital health, consumer technology, or a related field

• Strong foundation in statistical inference, hypothesis testing, regression, experimental design, uncertainty quantification, and validation study design; experience with equivalence, non-inferiority, causal inference, method-comparison, or related approaches is a plus

• Proficiency analyzing large datasets using Python, R, or similar statistical programming tools, along with SQL and experience working with large-scale data environments

• Experience with physiological, wearable, biomedical sensor, time-series, or longitudinal data; experience evaluating machine learning or signal processing algorithms is a plus

• Familiarity with advanced statistical methodologies such as mixed-effects models, Bayesian statistics, survival analysis, fairness and parity analysis, or related approaches

• Strong communication and collaboration skills, with the ability to translate complex statistical findings into clear conclusions and recommendations for both technical and non-technical stakeholders

• Strong commitment to embracing and leveraging AI tools in day-to-day tasks, ensuring AI-assisted work aligns with the same high-quality standards as personal contributions.

WHOOP is an Equal Opportunity Employer and participates in E-Verify to determine employment eligibility. It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.