Psychology Research Expert

AfterQuery; Deutschland; Remote; EUR 74,000 - 147,000; Full time

Job summary

AfterQuery is hiring psychology researchers as contractors to author and grade behavioral science scenarios used to test model judgment. The role centers on designing realistic scenarios from study design through interpretation and writing reference answers with explicit reasoning.

You will grade model outputs for construct validity, inference quality, and replication awareness, flag overstated claims, and work remotely with a minimum of 10 hours per week.

Qualifications

• Advanced degree in psychology or a closely related behavioral science.
• 2+ years of research experience with human subjects or behavioral data.
• Working command of study design, measurement, and statistical inference.
• Clear written English for documenting behavioral reasoning.
• Able to commit at least 10 hours per week.

Responsibilities

• Author realistic behavioral science scenarios from study design through interpretation.
• Write reference answers with the methodological reasoning behind each conclusion, constructs, confounds, and effect sizes weighed.
• Grade model output for construct validity, inference quality, and replication awareness.
• Flag claims that read plausible but overstate what the evidence supports.

Skills

Clear written English

Study design knowledge

Statistical inference

Education

Advanced degree in psychology or closely related behavioral science

Job description

Psychology researchers to build the behavioral science scenarios frontier AI labs use to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We're hiring psychology researchers as contractors to author and grade the behavioral science scenarios those evaluations run on. This is our social science listing, and every psychology specialty is welcome.

What you'll actually do

Author realistic behavioral science scenarios from study design through interpretation, the kind a working researcher actually reasons through. Write reference answers with the methodological reasoning behind each conclusion, constructs, confounds, and effect sizes weighed. Grade model output for construct validity, inference quality, and replication awareness. Flag claims that read plausible but overstate what the evidence supports, the misses only a trained researcher would catch.

Who this is for

Psychology researchers with an advanced degree in psychology or a closely related behavioral science. Academics, UX researchers, and applied behavioral scientists with at least two years of human subjects or behavioral data research. Researchers who reason from methods and evidence, and know what the replication crisis taught the field. People with strong written English who can turn methodological judgment into clear, teachable reasoning.

Contract and pay

$60 to $120/hr, paid weekly via Stripe. Your rate is set from your experience, not negotiated down after you start. Fully remote, fully async. No fixed hours. Minimum 10 hours per week, no maximum. Scale up or down week to week. No screen recording, no keystroke monitoring, no idle timers. Independent contractor. Ongoing project work rather than single task batches.

About AfterQuery

AfterQuery is an expert data lab. We build the evaluation and training data that frontier AI labs use to measure what their models can and can't do in real professional work. Our contributors are practicing professionals, not annotators, and the work is credited, reviewed, and paid at professional rates.

Responsibilities

• Author realistic behavioral science scenarios from study design through interpretation
• Write reference answers with the methodological reasoning behind each conclusion
• Grade model output for construct validity, inference quality, and replication awareness
• Flag claims that read plausible but overstate what the evidence supports

Required Qualifications

• Advanced degree in psychology or a closely related behavioral science
• 2+ years of research experience with human subjects or behavioral data
• Working command of study design, measurement, and statistical inference
• Clear written English for documenting behavioral reasoning
• Able to commit at least 10 hours per week

Preferred Qualifications

• PhD and peer reviewed publications
• Cognitive, social, clinical, or industrial organizational specialty depth
• UX research or applied behavioral science industry experience

Why apply

• Work stays in your specialty, judged on methodological judgment rather than output volume
• Set your own hours and scale up or down week to week
• Weekly pay via Stripe at a rate set from your experience
• Your judgment shapes how the next generation of AI handles human behavior