Consultant

Room to Read; United States; Remote; USD 102,000 - 122,000; Part time

Job summary

Room to Read | ShiftEd Alliance is seeking a Quantitative Psychometric Consultant for a remote, U.S.-based engagement. The short-term consultancy supports validating the AGNAT tool across diverse contexts, with cross-country measurement invariance analysis and recommendations for scoring models and reporting scales.

The consultant will develop reproducible R code, documentation, and a decision tree to guide future analyses, and will present findings to both technical and nontechnical

Qualifications

• Advanced degree in psychometrics, quantitative psychology, educational measurement, statistics, or related field.
• Experience in cross-cultural assessment and multi-country measurement invariance.
• Experience with non-cognitive assessments (attitudes, norms, psychosocial measures).
• Proficiency in R including IRT/MIRT, CFA, multi-group modeling, and DIF analysis.
• Experience with multidimensional constructs and mixed item formats.
• Strong analytical, communication and documentation skills.

Responsibilities

• Conduct psychometric analyses to assess item quality, reliability, and dimensional structure.
• Compare raw-score, IRT, and multidimensional IRT scoring approaches.
• Evaluate measurement invariance and DIF across countries and demographic groups.
• Recommend scoring models, reporting scales, and item revisions.
• Develop reproducible R code, technical documentation, and a decision tree.
• Present findings and recommendations to technical and nontechnical stakeholders.

Skills

Cross-cultural assessment

R programming

IRT/MIRT analysis

Differential item functioning (DIF)

Multidimensional modeling

Statistical analysis

Education

Advanced degree in psychometrics or related field

Tools

R (IRT/MIRT)

Confirmatory factor analysis

Multi-group modeling

Job description

Quantitative Psychometric Consultant (Remote, U.S.-Based)

Application Deadline: November 6, 2026

Room to Read | ShiftEd Alliance

Engagement: Short-term consultancy

Location: Remote – United States

Anticipated Start Date: November 23, 2026

Duration: Approximately 20 working days through early January 2027

Budget: $10,000

Room to Read, on behalf of the ShiftEd Alliance, is seeking an experienced Quantitative Psychometric Consultant to support the validation of the Adolescent Gender Norms Assessment Tool (AGNAT).

AGNAT is designed to measure changes in gender norms and stereotypes among adolescents across diverse cultural and linguistic contexts. The broader study is expected to include more than 12,000 students, with data from multiple countries.

Working with Room to Read's Research, Monitoring and Evaluation (RM&E) team and ShiftEd Alliance technical leads, the consultant will evaluate the tool's measurement structure, scoring approaches, and comparability across populations.

Key Responsibilities

• Conduct psychometric analyses to assess item quality, reliability, and dimensional structure.
• Compare raw-score, item response theory (IRT), and multidimensional IRT (MIRT) scoring approaches.
• Evaluate measurement invariance and differential item functioning (DIF) across countries and demographic groups.
• Recommend appropriate scoring models, reporting scales, and item revisions.
• Develop reproducible R code, technical documentation, and a decision tree to guide future analyses.
• Present findings and recommendations to technical and nontechnical stakeholders.

Required Qualifications

• Advanced degree in psychometrics, quantitative psychology, educational measurement, statistics, or a related field, or equivalent demonstrated expertise.
• Demonstrated experience in cross-cultural assessment and multi-country measurement invariance.
• Experience with non-cognitive assessments, including attitudes, norms, or psychosocial measures.
• Advanced proficiency in R, including IRT/MIRT, confirmatory factor analysis, multi-group modeling, and DIF analysis.
• Experience analyzing multidimensional constructs and mixed item formats.
• Strong analytical, communication, and technical documentation skills.
• Experience with adolescent populations, gender norms, education, or international research partnerships is highly desirable.

The consultant will provide psychometric analyses, scoring and scaling recommendations, measurement invariance findings, a consolidated technical report, documented R code, and supporting materials for future analyses.