Senior Psychometrician: AI-Driven Assessment (Remote)

NBME; Philadelphia (Philadelphia County); À distance; USD 139 000 - 173 000; Plein temps

Avantages offerts par ce poste

Remote friendly workplace

Healthcare benefits

401(k) with match

Tuition reimbursement

Commuter benefits

Résumé du poste

NBME is seeking a Senior Psychometrician to advance measurement science across operational assessment programs. The role focuses on IRT/CTT, scoring and equating, and developing AI-enabled approaches in assessment processes.

The candidate will drive research, contribute to reporting, and collaborate with data analysis, test development, and IT teams, while communicating complex concepts to varied audiences.

Qualifications

• PhD in Educational Measurement or related quantitative field.
• Strong foundation in IRT, CTT, and measurement theory.
• Experience translating results into clear visual displays for stakeholders.
• Familiarity with AI / ML in assessment is a plus.
• Proficiency in SAS, Python, or R for psychometrics.

Responsabilités

• Lead applied research to improve examination design and psychometric methods.
• Plan and evaluate analyses for scoring, equating, scaling, and reporting.
• Develop and evaluate responsible uses of AI and emerging analytics in assessment.
• Advance the field through presentations, publications, and research.
• Assess current processes and identify AI/automation improvements.
• Create data visualizations for stakeholder reports and interactive tools.

Connaissances

IRT

CTT

Statistical methods

Research design

Data visualization

Python

R

SAS

Formation

Doctoral degree in Educational Measurement or related field

Outils

SAS

Python

R

Calibration software

Description du poste

NBME is seeking a Senior Psychometrician to advance measurement science across operational assessment programs. The role focuses on IRT/CTT, scoring and equating, and developing AI-enabled approaches in assessment processes.

The candidate will drive research, contribute to reporting, and collaborate with data analysis, test development, and IT teams, while communicating complex concepts to varied audiences.