Remote Certification Exam Architect

PSI Services; Montpelier (VT); Remote; USD 82,000 - 100,000; Full time

Benefits offered by this job

401k/Pension

Enhanced PTO

Medical insurance (US)

Job summary

PSI Services is hiring a Test Development Specialist to own the full cycle of licensure examination development. The role is client-facing, combines content creation with psychometric analysis, and supports remote work with occasional travel up to 25%.

The candidate will design analyses, create and review test items, and collaborate with clients to ensure adherence to contracts and best practices in test development.

Qualifications

• Master’s degree in I/O psychology, measurement, education or related assessment area.
• 3+ years in professional test development.
• Experience in Certification/Licensure testing.
• Training in psychometrics.
• Experience managing multiple projects with timelines.
• Proficient with Microsoft Office apps.
• Knowledge of SAS, SPSS and/or SQL.
• Experience facilitating standard setting with clients.

Responsibilities

• Construct, maintain and validate licensure/certification tests.
• Design job analysis studies (surveys, focus groups).
• Develop and update test content specifications.
• Develop and review items for written/performance exams.
• Lead item/exam development meetings on-site or virtually.
• Perform statistical analyses and post-launch evaluation.
• Lead standard setting workshops and analyses.
• Prepare technical reports on development and maintenance.
• Manage client project portfolios to meet quality and timelines.
• Provide client-facing documentation of development activities.

Skills

Test development

Project management

Psychometrics

MS Office

Standard setting

I/O psychology

Communication

Client-facing

Education

Master’s degree in I/O psychology or related

PhD desirable

Tools

SAS

SPSS

SQL

Job description

PSI Services is hiring a Test Development Specialist to own the full cycle of licensure examination development. The role is client-facing, combines content creation with psychometric analysis, and supports remote work with occasional travel up to 25%.

The candidate will design analyses, create and review test items, and collaborate with clients to ensure adherence to contracts and best practices in test development.