Remote Certification Exam Architect

PSI Services; Cheyenne (WY); Remote; USD 82,000 - 100,000; Full time

Benefits offered by this job

401k/Pension/Retirement Plan – country

Enhanced PTO/Annual Leave

Medical insurance – US

Dental, Vision, Life

Job summary

PSI Services is hiring a Test Development Specialist to manage the full cycle of licensure examination development, including content, psychometrics, and client-facing activities. The role is remote with up to 25% travel and offers a permanent, full-time position with flexible hours around core office availability.

The ideal candidate has a Master’s in I/O psychology or related field, 3+ years in test development, and experience with certification/licensure testing.

Qualifications

• Master's degree in I/O psychology, measurement, education or related area.
• 3+ years of professional test development experience.
• Experience in testing for certification/licensure.
• Training and experience in psychometrics.
• Experience managing multiple projects, timelines and deliverables.
• Proficiency with Microsoft Office applications.
• Knowledge of SAS, SPSS and/or SQL preferred.
• Experience facilitating standard setting or similar workshops with clients.

Responsibilities

• Construct, maintain and validate licensure and certification tests.
• Design job analysis studies with surveys and focus groups.
• Develop and update test content specifications.
• Develop and review test items for written or performance exams.
• Lead item and exam development meetings onsite or virtually.
• Conduct statistical analyses of items and examinations post-launch.
• Facilitate standard setting workshops and studies.
• Produce reports on exam development and psychometric evaluation.
• Manage client project portfolios to meet quality and timelines.
• Provide client-facing documentation of activities and methods.
• Participate in operational projects and research studies.

Skills

Project management

Client communication

Psychometrics

Workshop facilitation

Data analysis

Attention to detail

Education

Master's degree in I/O psychology or related field

PhD desirable

Tools

SAS

SPSS

SQL

Microsoft Office

Job description

PSI Services is hiring a Test Development Specialist to manage the full cycle of licensure examination development, including content, psychometrics, and client-facing activities. The role is remote with up to 25% travel and offers a permanent, full-time position with flexible hours around core office availability.

The ideal candidate has a Master’s in I/O psychology or related field, 3+ years in test development, and experience with certification/licensure testing.