Consultant

NCME; United States; Remote; USD 55,000 - 96,000; Part time

Job summary

Room to Read, on behalf of the ShiftEd Alliance, seeks a Quantitative Psychometric Consultant to support AGNAT validation across diverse contexts.

The role involves evaluating measurement structure, scoring models, and cross-country comparability with RM&E and ShiftEd leads.

Qualifications

• Advanced degree in psychometrics or a related field.
• Experience in cross-cultural assessment and multi-country measurement invariance.
• Experience with non-cognitive assessments (attitudes, norms, psychosocial measures).
• Advanced proficiency in R, including IRT/MIRT, CFA, multi-group modeling, and DIF analysis.

Responsibilities

• Conduct psychometric analyses to assess item quality, reliability, and dimensional structure.
• Compare raw-score, IRT, and multidimensional IRT (MIRT) scoring approaches.
• Evaluate measurement invariance and differential item functioning (DIF) across countries and demographic groups.
• Develop reproducible R code, technical documentation, and a decision tree to guide future analyses.
• Present findings and recommendations to technical and nontechnical stakeholders.

Skills

Cross-cultural assessment

Multi-country invariance

R (IRT/MIRT)

DIF analysis

Psychometrics

Education

Advanced degree in psychometrics or related field

Tools

R

Job description

FLSA Status: Not Applicable

Position Status: Part Time

Position Overview

Room to Read, on behalf of the ShiftEd Alliance, is seeking an experienced Quantitative Psychometric Consultant to support the validation of the Adolescent Gender Norms Assessment Tool (AGNAT). AGNAT is designed to measure changes in gender norms and stereotypes among adolescents across diverse cultural and linguistic contexts. The broader study is expected to include more than 12,000 students, with data from multiple countries.

Working with Room to Read’s Research, Monitoring and Evaluation (RM&E) team and ShiftEd Alliance technical leads, the consultant will evaluate the tool’s measurement structure, scoring approaches, and comparability across populations.

Essential Job Functions

Key Responsibilities

• Conduct psychometric analyses to assess item quality, reliability, and dimensional structure.
• Compare raw-score, item response theory (IRT), and multidimensional IRT (MIRT) scoring approaches.
• Evaluate measurement invariance and differential item functioning (DIF) across countries and demographic groups.
• Recommend appropriate scoring models, reporting scales, and item revisions.
• Develop reproducible R code, technical documentation, and a decision tree to guide future analyses.
• Present findings and recommendations to technical and nontechnical stakeholders.

Qualifications Preferred

Required Qualifications

• Advanced degree in psychometrics, quantitative psychology, educational measurement, statistics, or a related field, or equivalent demonstrated expertise.
• Demonstrated experience in cross-cultural assessment and multi-country measurement invariance.
• Experience with non-cognitive assessments, including attitudes, norms, or psychosocial measures.
• Advanced proficiency in R, including IRT/MIRT, confirmatory factor analysis, multi-group modeling, and DIF analysis.
• Experience analyzing multidimensional constructs and mixed item formats.
• Strong analytical, communication, and technical documentation skills.
• Experience with adolescent populations, gender norms, education, or international research partnerships is highly desirable.