Statistician & Experimentation Expert

AfterQuery; New Zealand; Remote; NZD 193,000 - 363,000; Full time

Benefits offered by this job

100% remote work

Weekly payments via Stripe

Ongoing project work

Flexible hours

Job summary

AfterQuery is hiring statisticians and experimentation experts as contractors to author and grade causal inference and A/B testing scenarios used by frontier AI labs to evaluate model reasoning. This is a fully remote, asynchronous contractor role with no fixed hours, requiring at least 10 hours per week.

The work focuses on study design, analysis, interpretation, and rigorous critique of model outputs, with compensation ranging from $80 to $150 per hour, paid weekly via Stripe.

Qualifications

• Advanced degree in statistics, biostatistics, or a closely related quantitative field.
• 2+ years of applied statistics or experimentation experience.
• Depth in experimental design, causal inference, or A/B testing.
• Fluency in R or Python for statistical analysis.
• Able to commit at least 10 hours per week.

Responsibilities

• Author realistic statistics scenarios from study design through analysis and interpretation
• Write reference answers with the statistical reasoning behind each modeling choice
• Grade model output for methodological soundness and correct interpretation
• Flag analyses that read rigorous but draw invalid conclusions

Skills

Advanced statistics

Experimental design

Causal inference

A/B testing

R or Python

Education

Advanced degree in statistics/biostatistics

PhD in statistics/ econometrics (preferred)

Job description

Statisticians and experimentation experts in causal inference and A/B testing to build the scenarios frontier AI labs use to test model reasoning. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We're hiring statisticians and experimentation experts as contractors to author and grade the causal inference and A/B testing scenarios those evaluations run on. What you'll actually do Author realistic statistics scenarios, from study design through analysis and interpretationWrite reference answers with the statistical reasoning behind each modeling choiceGrade model output for methodological soundness and correct interpretationFlag analyses that read rigorous but draw invalid conclusions Who this is for Statisticians and biostatisticians with an advanced degree in a quantitative fieldPractitioners with at least 2 years of applied statistics or experimentation workExperts with depth in experimental design, causal inference, or A/B testingAnalysts fluent in R or Python who can document the reasoning behind a modeling choice Contract and pay $80 to $150/hr, paid weekly via Stripe. Your rate is set from your experience, not negotiated down after you start.Remote, fully async. No fixed hours.Minimum 10 hours per week, no maximum. Scale up or down week to week.No screen recording, no keystroke monitoring, no idle timers.Independent contractor. Ongoing project work rather than single task batches. About AfterQuery AfterQuery is an expert data lab. We build the evaluation and training data that frontier AI labs use to measure what their models can and can't do in real professional work. Our contributors are practicing professionals, not annotators, and the work is credited, reviewed, and paid at professional rates.

Responsibilities

• Author realistic statistics scenarios from study design through analysis and interpretation
• Write reference answers with the statistical reasoning behind each modeling choice
• Grade model output for methodological soundness and correct interpretation
• Flag analyses that read rigorous but draw invalid conclusions

Required Qualifications

• Advanced degree in statistics, biostatistics, or a closely related quantitative field
• 2+ years of applied statistics or experimentation experience
• Depth in experimental design, causal inference, or A/B testing
• Fluency in R or Python for statistical analysis
• Able to commit at least 10 hours per week

Preferred Qualifications

• PhD in statistics, biostatistics, or econometrics
• Experience running large scale experimentation platforms
• Bayesian methods or advanced causal inference such as instrumental variables or synthetic control

Why apply

• $80 to $150/hr, paid weekly via Stripe
• 100% remote and fully async
• Shape how frontier models reason about statistics and causality
• Ongoing project work with hours you set each week