Certification Exam Development Specialist

PSI Services; Montpelier (VT); Remote; USD 82,000 - 100,000; Full time

Benefits offered by this job

401k/Pension

Enhanced PTO

Medical insurance (US)

Job summary

PSI Services is hiring a Test Development Specialist to own the full cycle of licensure examination development. The role is client-facing, combines content creation with psychometric analysis, and supports remote work with occasional travel up to 25%.

The candidate will design analyses, create and review test items, and collaborate with clients to ensure adherence to contracts and best practices in test development.

Qualifications

• Master’s degree in I/O psychology, measurement, education or related assessment area.
• 3+ years in professional test development.
• Experience in Certification/Licensure testing.
• Training in psychometrics.
• Experience managing multiple projects with timelines.
• Proficient with Microsoft Office apps.
• Knowledge of SAS, SPSS and/or SQL.
• Experience facilitating standard setting with clients.

Responsibilities

• Construct, maintain and validate licensure/certification tests.
• Design job analysis studies (surveys, focus groups).
• Develop and update test content specifications.
• Develop and review items for written/performance exams.
• Lead item/exam development meetings on-site or virtually.
• Perform statistical analyses and post-launch evaluation.
• Lead standard setting workshops and analyses.
• Prepare technical reports on development and maintenance.
• Manage client project portfolios to meet quality and timelines.
• Provide client-facing documentation of development activities.

Skills

Test development

Project management

Psychometrics

MS Office

Standard setting

I/O psychology

Communication

Client-facing

Education

Master’s degree in I/O psychology or related

PhD desirable

Tools

SAS

SPSS

SQL

Job description

Description

Title: Test Development Specialist

Location: Remote-US

Salary: Up to $91K

About PSI

We are PSI Services. We power world leading tests. Delivered with trusted science and the very best test taker experience. PSI supports test-takers on their journey to pursuing dreams and gaining certifications that are important to them. They believe that their dreams are worth working for; that their dreams are worth the effort. And we believe that too. This is our core purpose, to empower people to achieve their dreams. We do this by being the best provider of workforce solutions, which foster both technology and science to deliver the best solutions for our test takers.

We are searching for top talent to join our PSI team and help grow our products and services. We have a creative, supportive and inclusive culture where we empower people in their careers to be their authentic self and make the most of their great talent.

At PSI, we are committed to helping people meet their potential and we believe that promoting diversity, equity and inclusion is critical to our success. That’s why you’ll find these ideals are intrinsic to our company culture and applied throughout the employee lifecycle.

Learn more about what we do at: https://www.psiexams.com/

About the Role

The Test Development Specialist is responsible for the full cycle of development for Licensure Examinations which adhere to the requirements detailed in each client’s contract and industry practices. This position is client facing and includes content development and psychometric analysis responsibilities.

This is a full-time permanent role, with flexible hours around core office availability Monday to Friday. The role can be performed remotely, with occasional travel (up to 25%) required for meetings, events and workshops.

Role Responsibilities

• Performs assignments related to the construction, maintenance and validation of licensure and certification tests.
• Designs and conducts job analysis studies, including surveys and focus groups.
• Develops and updates test content specifications.
• Develops and reviews test items for written and/or performance exams.
• Facilitates item and exam development committee meetings and training sessions being conducted on-site or virtually.
• Conducts statistical analyses of items, constructs examinations, and evaluates exams post-launch.
• Facilitates standard setting workshops and studies.
• Conducts pre-equating or post-equating analyses as needed.
• Writes technical reports related to examination development, performance, and maintenance.
• Manages portfolio of client projects to ensure deliverables are completed according to quality standards and project timelines.
• Consults with clients regarding test development methods and best practices.
• Provides client-facing documentation to report activities related to test development and psychometric evaluation.
• Performs operational projects and research studies.
• Proposes and presents at professional conferences and conducts research for publications.

Knowledge, Skills and Experience Requirements

• Education to Master’s degree level (Ph.D. desirable) in I/O psychology, measurement, education or other assessment related area.
• 3 or more years’ experience in professional test development
• Testing experience in Certification and/or Licensure industry
• Training and experience in the use of psychometrics
• Experience in managing multiple project assignments, timelines and deliverables
• Proficiency with Microsoft Office applications.
• Knowledge of SAS, SPSS and/or SQL preferred.
• Experience facilitating standard setting or similar workshops with clients

Benefits

At PSI, our culture is to be transparent and fair. That’s why all of our roles have been benchmarked at a competitive rate against the local market they are based in. To be transparent all of our adverts now include the salary so you can see if we align with your expectations when looking for your next role.

In addition to a competitive salary, we offer a comprehensive benefits package and supportive culture when you join us. This includes:

• 401k/Pension/Retirement Plan – with country specific employer %
• Enhanced PTO/Annual Leave
• Medical insurance – country specific
• Dental, Vision, Life and Short Term Disability for US
• Flexible Spending Accounts – for the US
• Medical Cashback plan covering vision, dental and income protection for UK
• Employee Assistance Programme
• Commitment and understanding of work/life balance
• Dedicated DE&I group that drive core people initiatives
• A culture of embracing wellness, including regular global initiatives
• Access to supportive and professional mechanisms to help you plan for your future
• Volunteer Day and a culture of giving back to our community and industry through volunteering opportunities

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities

This employer is required to notify all applicants of their rights pursuant to federal employment laws.

For further information, please review the Know Your Rights (https://www.eeoc.gov/poster) notice from the Department of Labor.