Senior Psychometrician - Remote Data & Measurement Expert

National Board of Medical Examiners

Philadelphia (Philadelphia County)

Remote

USD 139,000 - 173,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Remote Friendly Workplace
Healthcare benefits
Dental insurance
Prescription plans
Vision plans
401(k) with match
Tuition Reimbursement Plan
Commuter Benefit

Job summary

National Board of Medical Examiners seeks a Senior Psychometrician to advance examination design, scoring, and reporting across NBME programs. You will collaborate with data analysts, test developers, IT staff, and program managers while engaging external clients with expertise from medical fields.

The role emphasizes remote flexibility with options for hybrid or onsite work near Philadelphia, PA, and requires publication-quality research to influence assessment practices.

Qualifications

  • PhD in Educational/Psychological Measurement, Statistics, or related field.
  • Minimum 5 years in a Psychometrician/Measurement Scientist role.
  • Strong background in psychometric theory and related measurement methods.

Responsibilities

  • Lead applied research and development for examination designs and analysis methods.
  • Plan and perform psychometric analyses, scoring, and score reporting for operational programs.
  • Present findings to educational measurement communities via presentations/publications.
  • Evaluate current procedures to identify improvements for accuracy and efficiency.
  • Design and evaluate data visualizations and interactive data tools for stakeholders.
  • Support AI-related research initiatives.

Skills

Psychometric theory
IRT/CTT statistics
Data visualization
Natural language processing
Statistical software
Communication skills
Interpersonal skills

Education

Doctorate in Educational/Psychological Measurement

Tools

SAS
Python
R
Calibration software

Job description

National Board of Medical Examiners seeks a Senior Psychometrician to advance examination design, scoring, and reporting across NBME programs. You will collaborate with data analysts, test developers, IT staff, and program managers while engaging external clients with expertise from medical fields.

The role emphasizes remote flexibility with options for hybrid or onsite work near Philadelphia, PA, and requires publication-quality research to influence assessment practices.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Senior Psychometrician: AI-Driven Assessment
Remote Senior Psychometrician: AI-Driven Assessment

National Board of Medical Examiners • Philadelphia

Remote
USD 139,000 - 173,000
Remote friendly workplace
Healthcare plans
401(k) match
+2
Senior Psychometrician
Senior Psychometrician

NBME • Philadelphia

Remote
USD 139,000 - 173,000
Remote friendly workplace
Healthcare benefits
401(k) with match
+2
Senior Psychometrician
Senior Psychometrician

National Board of Medical Examiners • Philadelphia

Remote
USD 139,000 - 173,000
Remote friendly workplace
Healthcare plans
401(k) match
+2
Senior Psychometrician: AI-Driven Assessment (Remote)
Senior Psychometrician: AI-Driven Assessment (Remote)

NBME • Philadelphia

Remote
USD 139,000 - 173,000
Remote friendly workplace
Healthcare benefits
401(k) with match
+2
Technical Customer Support Resource Specialist I
Technical Customer Support Resource Specialist I

NBME • Philadelphia

On-site
USD 50,000 - 60,000
Remote-friendly workplace
Healthcare, dental, vision plans
401(k) with match
+2
Technical Support Specialist - Exam Support (Weekends)
Technical Support Specialist - Exam Support (Weekends)

NBME • Philadelphia

On-site
USD 50,000 - 60,000
Psychometrician I — Data-Driven Exam Analytics
Psychometrician I — Data-Driven Exam Analytics

National Commission On Certification Of Physicians • Johns Creek (GA)

Remote
USD 82,000 - 98,000
Manager, Examinee Accommodations
Manager, Examinee Accommodations

NBME • Philadelphia

Remote
USD 114,970 - 143,700
Healthcare benefits
401(k) with match
Remote friendly workplace
+1
Data Engineer III
Data Engineer III

NBME • Philadelphia

Hybrid
USD 112,000 - 140,000
Remote-friendly workplace
AWS Application Developer
AWS Application Developer

NBME • Philadelphia

Remote
USD 115,000 - 160,000
Healthcare
Dental
Vision
+4