Lead Psychometrician, Language Assessment & Validation

Doist; Washington (District of Columbia); On-site; USD 120,000 - 160,000; Full time

Job summary

CAL in Washington, DC is seeking a Psychometrician to design and conduct psychometric analyses for language testing programs, including validity, reliability, equating, and scoring. Under the Director of Psychometrics and Quantitative Research, you will develop QA procedures and prepare technical reports.

The role provides quantitative guidance to researchers and coordinates external quantitative resources, supporting proposals and client collaboration with academia and education partners.

Qualifications

• Experience designing and evaluating psychometric analyses for language testing.
• Familiarity with classical test theory and Rasch-based methods.
• Ability to prepare technical reports and present results clearly.

Responsibilities

• Design and conduct psychometric analyses for performance tests including validity, reliability, and equating.
• Prepare technical reports and support quality control procedures.
• Provide quantitative guidance to researchers and coordinate external quantitative resources.
• Support outreach and collaboration with external partners and academia.

Skills

Psychometrics

Quantitative analysis

Rasch model

Winsteps

Facets software

Item response theory

Data visualization

Proposal writing support

Tools

Winsteps

Facets

Rasch modeling

Job description

CAL in Washington, DC is seeking a Psychometrician to design and conduct psychometric analyses for language testing programs, including validity, reliability, equating, and scoring. Under the Director of Psychometrics and Quantitative Research, you will develop QA procedures and prepare technical reports.

The role provides quantitative guidance to researchers and coordinates external quantitative resources, supporting proposals and client collaboration with academia and education partners.