Remote Senior Psychometrician — Measurement Scientist

St. Cloud Orthopedics; Philadelphia (Philadelphia County); Hybrid; USD 139,000 - 173,000; Full time

Benefits offered by this job

Remote-friendly workplace

Job summary

NBME’s PADA unit is seeking a Senior Psychometrician to lead psychometric analyses, design and reporting for operational examination programs. You will collaborate with data analysts, test developers, information technologists, and program managers, and engage clients and subject-matter experts.

The role emphasizes applied research, data visualization, and AI-related initiatives. It offers a primarily remote arrangement with flexible options for remote, hybrid, or onsite work, and expects a

Qualifications

• Strong background in psychometric theory and application.
• Knowledge of IRT, CTT, statistics, test development procedures and research design.
• Ability to present assessment data graphically to inform decisions.
• Excellent communication and collaboration with diverse stakeholders.
• Experience with SAS, Python or R preferred.

Responsibilities

• Plan and execute psychometric analyses, scoring, and score reporting for operational programs.
• Conduct applied research and contribute to exam design modifications.
• Present data visually to facilitate understanding and action.
• Collaborate with internal teams and external clients and experts.
• Support AI-related research initiatives.
• Evaluate procedures to improve accuracy and efficiency.

Skills

Psychometric theory

IRT

CTT

Statistics

Test development

Research design

NLP familiarity

Data visualization

Communication skills

Education

Doctorate in Educational/Psychological Measurement or Statistics

Tools

SAS

Python

R

Calibration software

Job description

NBME’s PADA unit is seeking a Senior Psychometrician to lead psychometric analyses, design and reporting for operational examination programs. You will collaborate with data analysts, test developers, information technologists, and program managers, and engage clients and subject-matter experts.

The role emphasizes applied research, data visualization, and AI-related initiatives. It offers a primarily remote arrangement with flexible options for remote, hybrid, or onsite work, and expects a