Senior Psychometrician (Remote) — Data-Driven Assessment Design

International Council for Veterinary Assessment; Philadelphia (Philadelphia County); Hybrid; USD 139,000 - 173,000; Full time

Benefits offered by this job

Remote friendly workplace

Job summary

NBME’s Psychometrics and Data Analysis (PADA) unit seeks a Senior Psychometrician to advance examination design, develop psychometric analyses, and report scores for operational exams. The role emphasizes collaboration with data analysts, test developers, and program managers, with client engagement across medical fields.

Remote-friendly and open to flexible work arrangements across multiple states, including PA, NJ, DE, and others.

Qualifications

• PhD in Educational/Psychological Measurement, Statistics, or related field is required.
• Minimum 5 years of experience as Psychometrician/Measurement Scientist.
• Strong background in psychometric theory and test development procedures.
• Experience presenting assessment data graphically to facilitate interpretation.

Responsibilities

• Conduct applied research to support examination design and analysis methods.
• Plan and execute psychometric analyses, scoring, and score reporting for operational exams.
• Contribute to the educational measurement community via presentations and publications.
• Evaluate existing procedures and identify improvements for accuracy and efficiency.
• Design data visualization for stakeholder feedback and interactive tools.
• Support AI-related research initiatives.

Skills

IRT/CTT knowledge

Statistics methods

Data visualization

NLP familiarity

Statistical software

Communication skills

Problem solving

Interpersonal skills

Education

Doctorate in Educational/Psychological Measurement or Statistics

Tools

SAS

Python

R

Calibration software

Job description

NBME’s Psychometrics and Data Analysis (PADA) unit seeks a Senior Psychometrician to advance examination design, develop psychometric analyses, and report scores for operational exams. The role emphasizes collaboration with data analysts, test developers, and program managers, with client engagement across medical fields.

Remote-friendly and open to flexible work arrangements across multiple states, including PA, NJ, DE, and others.