Senior Psychometrician - Remote Data & Measurement Expert

National Board of Medical Examiners; Philadelphia (Philadelphia County); On-site; USD 139,000 - 173,000; Full time

Benefits offered by this job

Remote Friendly Workplace

Healthcare benefits

Dental insurance

Prescription plans

Vision plans

401(k) with match

Tuition Reimbursement Plan

Commuter Benefit

Job summary

National Board of Medical Examiners seeks a Senior Psychometrician to advance examination design, scoring, and reporting across NBME programs. You will collaborate with data analysts, test developers, IT staff, and program managers while engaging external clients with expertise from medical fields.

The role emphasizes remote flexibility with options for hybrid or onsite work near Philadelphia, PA, and requires publication-quality research to influence assessment practices.

Qualifications

• PhD in Educational/Psychological Measurement, Statistics, or related field.
• Minimum 5 years in a Psychometrician/Measurement Scientist role.
• Strong background in psychometric theory and related measurement methods.

Responsibilities

• Lead applied research and development for examination designs and analysis methods.
• Plan and perform psychometric analyses, scoring, and score reporting for operational programs.
• Present findings to educational measurement communities via presentations/publications.
• Evaluate current procedures to identify improvements for accuracy and efficiency.
• Design and evaluate data visualizations and interactive data tools for stakeholders.
• Support AI-related research initiatives.

Skills

Psychometric theory

IRT/CTT statistics

Data visualization

Natural language processing

Statistical software

Communication skills

Interpersonal skills

Education

Doctorate in Educational/Psychological Measurement

Tools

SAS

Python

R

Calibration software

Job description

National Board of Medical Examiners seeks a Senior Psychometrician to advance examination design, scoring, and reporting across NBME programs. You will collaborate with data analysts, test developers, IT staff, and program managers while engaging external clients with expertise from medical fields.

The role emphasizes remote flexibility with options for hybrid or onsite work near Philadelphia, PA, and requires publication-quality research to influence assessment practices.