Remote Psychometric Analyst for High-Stakes Testing

Association of International Certified Professional Accountants; Durham (NC); On-site; USD 80,000 - 95,000; Full time

Benefits offered by this job

Healthcare

Retirement

Paid time off

Parental leave

Employee assistance program

Mental health resources

Job summary

Association of International Certified Professional Accountants seeks a Psychometrics & Research professional to perform large-scale calibrations, scoring, monitoring, program improvement, and technical reporting for the Uniform CPA Examination. You will analyze data across operational and research contexts and help implement system/process improvements.

Remote role within the United States. The candidate will work with the Examinations Team under the Director, Psychometrics & Research, bringing

Qualifications

• Ph.D. in Psychometrics, I/O psychology, Quantitative Psychology, Educational Measurement or a related field.
• Entry-level candidates and recent graduates with relevant coursework, research, or internship experience will be considered.
• Experience with statistical/psychometric programming, machine learning, Natural Language Processing, and/or LLM implementations in test development and psychometrics.
• 0–1 years of experience in psychometric analysis within high-stakes testing, certification, or licensure assessment environments.

Responsibilities

• Prepare item analysis output for item development and program improvement.
• Calibrate and maintain item banks using Item Response Theory methods and classical item statistics.
• Perform calibration and scoring reviews.
• Conduct quality control and data integrity analyses for scoring and reporting; help with procedural and QA documentation for partners.
• Support/conduct multiple psychometric analyses, including DIF, dimensionality, scaling, equating, and speediness analyses.
• Help design and implement research studies in response to planned and ad-hoc needs.
• Help develop quarterly and annual technical reporting.

Skills

Statistical programming

Machine learning

Natural Language Processing

LLM implementations

Education

Ph.D. in Psychometrics / related field

Job description

Association of International Certified Professional Accountants seeks a Psychometrics & Research professional to perform large-scale calibrations, scoring, monitoring, program improvement, and technical reporting for the Uniform CPA Examination. You will analyze data across operational and research contexts and help implement system/process improvements.

Remote role within the United States. The candidate will work with the Examinations Team under the Director, Psychometrics & Research, bringing