Senior Psychometrics Scientist (Remote)

ISHE; Philadelphia, Northern (Philadelphia County, KY); Hybrid; USD 139,000 - 173,000; Full time

Benefits offered by this job

Healthcare

Tuition Reimbursement

401(k) with match

Commuter Benefit

Job summary

NBME seeks a Senior Psychometrician in a primarily remote role within the PADA unit. You will lead applied research in examination design, plan and execute psychometric analyses, and contribute to educational measurement through publications and presentations.

The role collaborates with data analysts, test developers, IT staff, and clients across medical fields. The position supports NBME's USMLE programs and international client assessments, with emphasis on data visualization, AI-related

Qualifications

• A minimum of 5 years of experience in a Psychometrician/Measurement Scientist role.
• Doctorate degree in Educational/Psychological Measurement, Statistics, or a related field is required.
• Strong collaboration and communication skills with internal teams and external clients.

Responsibilities

• Applied research and development in examination design and analysis methods.
• Plan and execute psychometric analyses, scoring, and score reporting for operational programs.
• Contribute to the educational measurement community via presentations and publications.
• Evaluate procedures to increase accuracy and efficiency of exam processing.
• Design data visualizations and graphical representations for stakeholders.
• Support AI-related research initiatives.

Skills

Psychometrics

IRT/CTT

Data visualization

NLP knowledge

SAS/Python/R

Communication skills

Cross-functional collaboration

Education

Doctorate in Educational/Psychological Measurement or Stats

Tools

SAS

Python

R

Calibration software

Job description

NBME seeks a Senior Psychometrician in a primarily remote role within the PADA unit. You will lead applied research in examination design, plan and execute psychometric analyses, and contribute to educational measurement through publications and presentations.

The role collaborates with data analysts, test developers, IT staff, and clients across medical fields. The position supports NBME's USMLE programs and international client assessments, with emphasis on data visualization, AI-related