Psychology Research Expert

AfterQuery; New Zealand; Remote; NZD 146,000 - 292,000; Full time

Job summary

AfterQuery is seeking psychology researchers to author and grade behavioral science scenarios used in frontier AI evaluations. This fully remote, independent contractor position offers weekly payments via Stripe and flexible hours.

Authors design studies, provide reference answers with methodological reasoning, and assess model outputs for validity and replication awareness. Candidates should have an advanced degree in psychology or related behavioral science and at least two years of human

Qualifications

• Requires advanced degree in psychology or related field.
• 2+ years of research with human subjects or behavioral data.
• Clear written English; ability to document behavioral reasoning.

Responsibilities

• Author realistic behavioral science scenarios from study design through interpretation.
• Write reference answers with methodological reasoning for conclusions, constructs, and effects.
• Grade model output for construct validity, inference quality, and replication awareness.
• Flag claims that are plausible but overstated by evidence.

Skills

2+ years of research experience

Education

Advanced degree in psychology or related behavioral science

PhD (preferred)

Job description

Psychology researchers to build the behavioral science scenarios frontier AI labs use to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We're hiring psychology researchers as contractors to author and grade the behavioral science scenarios those evaluations run on. This is our social science listing, and every psychology specialty is welcome.

What you'll actually do

Author realistic behavioral science scenarios from study design through interpretation, the kind a working researcher actually reasons through. Write reference answers with the methodological reasoning behind each conclusion, constructs, confounds, and effect sizes weighed. Grade model output for construct validity, inference quality, and replication awareness. Flag claims that read plausible but overstate what the evidence supports, the misses only a trained researcher would catch.

Who this is for

Psychology researchers with an advanced degree in psychology or a closely related behavioral science. Academics, UX researchers, and applied behavioral scientists with at least two years of human subjects or behavioral data research. Researchers who reason from methods and evidence, and know what the replication crisis taught the field. People with strong written English who can turn methodological judgment into clear, teachable reasoning.

Contract and pay

$60 to $120/hr, paid weekly via Stripe. Your rate is set from your experience, not negotiated down after you start. Fully remote, fully async. No fixed hours. Minimum 10 hours per week, no maximum. Scale up or down week to week. No screen recording, no keystroke monitoring, no idle timers. Independent contractor. Ongoing project work rather than single task batches.

About AfterQuery

AfterQuery is an expert data lab. We build the evaluation and training data that frontier AI labs use to measure what their models can and can't do in real professional work. Our contributors are practicing professionals, not annotators, and the work is credited, reviewed, and paid at professional rates.

Responsibilities

• Author realistic behavioral science scenarios from study design through interpretation
• Write reference answers with the methodological reasoning behind each conclusion
• Grade model output for construct validity, inference quality, and replication awareness
• Flag claims that read plausible but overstate what the evidence supports

Required Qualifications

• Advanced degree in psychology or a closely related behavioral science
• 2+ years of research experience with human subjects or behavioral data
• Working command of study design, measurement, and statistical inference
• Clear written English for documenting behavioral reasoning
• Able to commit at least 10 hours per week

Preferred Qualifications

• PhD and peer reviewed publications
• Cognitive, social, clinical, or industrial organizational specialty depth
• UX research or applied behavioral science industry experience

Why apply

• Work stays in your specialty, judged on methodological judgment rather than output volume
• Set your own hours and scale up or down week to week
• Weekly pay via Stripe at a rate set from your experience
• Your judgment shapes how the next generation of AI handles human behavior