Remote Quantitative Psychometrics Consultant (US-Based)

Room to Read; United States; Remote; USD 89,000 - 96,000; Part time

Job summary

Room to Read, on behalf of the ShiftEd Alliance, seeks a Quantitative Psychometric Consultant to validate the AGNAT tool across diverse contexts. You will evaluate measurement structure, scoring, and comparability, working with RM&E and technical leads.

The role involves supporting data from 12,000+ students across multiple countries, developing reproducible R code, and delivering a consolidated technical report with recommendations for future analyses.

Qualifications

• Advanced degree in psychometrics, quantitative psychology, educational measurement, statistics, or related field.
• Experience in cross-cultural assessment and multi-country measurement invariance.
• Experience with non-cognitive assessments (attitudes, norms, psychosocial measures).
• Proficiency in R including IRT/MIRT, CFA, multi-group modeling, DIF analysis.
• Experience with multidimensional constructs and mixed item formats.
• Strong analytical, communication, and technical documentation skills.
• Experience with adolescents, gender norms, education, or international research partnerships is desirable.

Responsibilities

• Conduct psychometric analyses to assess item quality, reliability, and dimensional structure.
• Compare raw-score, IRT, and MIRT scoring approaches.
• Evaluate measurement invariance and DIF across countries and demographics.
• Recommend scoring models, reporting scales, and item revisions.
• Develop reproducible R code, technical docs, and a decision tree for future analyses.
• Present findings to technical and nontechnical stakeholders.

Skills

Advanced statistical methods

Cross-cultural assessment

Non-cognitive assessments

R, IRT, MIRT, CFA, DIF

Multidimensional constructs

Analytical communication

Adolescent populations research

Education

Advanced degree in psychometrics or related field

Tools

R software

IRT/MIRT analysis

DIF analysis

Job description

Room to Read, on behalf of the ShiftEd Alliance, seeks a Quantitative Psychometric Consultant to validate the AGNAT tool across diverse contexts. You will evaluate measurement structure, scoring, and comparability, working with RM&E and technical leads.

The role involves supporting data from 12,000+ students across multiple countries, developing reproducible R code, and delivering a consolidated technical report with recommendations for future analyses.