Senior Psychometrician — Remote, AI-Driven Assessment Lead

National Board for Certification in Occupational Therapy, Inc; Gaithersburg (MD); Remote; USD 105,000 - 135,000; Full time

Benefits offered by this job

35-hour work week

Paid medical insurance

Matched 401K plan

Annual bonus and salary adjustments

Life insurance and disability

Voluntary benefits: vision, term life,

Pet insurance

Job summary

NBCOT is seeking a Senior Psychometrician to lead psychometric oversight, analysis, and consultation across certification programs for occupational therapy professionals.

You will conduct practice analyses, competency modeling, standard-setting, and advanced statistical work, delivering actionable insights to improve assessments and processes. Remote work with domestic travel is expected, 35-hour weeks and comprehensive benefits accompany the role.

Qualifications

• Doctoral degree in measurement, assessment, psychometrics, statistics, educational measurement, or related field; 3+ years in a psychometrician role.
• Strong knowledge of psychometric theory, validity, reliability, classical test theory, IRT.
• Experience with job/practice analyses, standard-setting, and exam development.
• Experience supporting certification or credentialing programs is preferred.
• Knowledge of machine learning/NLP is a plus.

Responsibilities

• Designs practice analyses and competency modeling to define knowledge, skills, and competencies for occupational therapy practice.
• Develops and validates competency frameworks and examination content outlines.
• Establishes passing standards using psychometric methods and conducts advanced analyses (IRT, DIF, equating).
• Designs scoring processes and generates score reports for test-takers and stakeholders.
• Researches and develops AI-driven tools to support psychometrics and assessment design.
• Manages large datasets for analyses, reporting, and reproducibility.

Skills

R

SPSS

Winsteps

Excel

Education

Doctoral degree in measurement/psychometrics

Tools

R

SPSS

Winsteps

Excel

Job description

NBCOT is seeking a Senior Psychometrician to lead psychometric oversight, analysis, and consultation across certification programs for occupational therapy professionals.

You will conduct practice analyses, competency modeling, standard-setting, and advanced statistical work, delivering actionable insights to improve assessments and processes. Remote work with domestic travel is expected, 35-hour weeks and comprehensive benefits accompany the role.