Certification Exam Architect — Remote

Paycom; Houston (TX); Hybrid; USD 85,000 - 120,000; Full time

Job summary

Paycom is seeking a Certification Exam Developer Specialist to lead development, updating, and performance monitoring of AMPP certification examinations. You will coordinate in-person and virtual SME meetings to ensure job-role alignment and defensible exam content.

The role emphasizes item writing, bank maintenance, and preparation of exams for production, with strong focus on exam security and quality control across multiple test forms. Travel may be required.

Qualifications

• Masters degree in Psychometrics or related field.
• 1-3 years professional test development experience.
• 1-3 years Job Task Analysis experience preferred.
• Strong knowledge of all Microsoft Office products.
• Experience in testing and assessment industry preferred; item and test development experience required.

Responsibilities

• Competency Model Facilitation: organize and assist in competency modeling workshops and maintain the model as the basis for exams.
• Blueprint Utilization: determine number of exam items after objectives are weighted.
• Exam Quality Process: oversee item development workshops and ensure content validity and proper formatting.
• Standard Setting Methodology: assist in facilitation of standard setting workshops and manage SME coordination.
• Exam Performance: analyze data, monitor validity and reliability, revise items as needed.
• Project Management: manage certification exam development, schedules, and deliverables.
• Support team members: respond to Certification Exam mailbox and coordinate workshops.
• Translations: ensure secure translations to reduce bias and improve quality.
• Board Liaison: work with Boards to recruit SMEs and drive initiatives.

Skills

Project management

Statistical item analysis

Communication

MS Office

Written & verbal communication

Global thinking

Attention to detail

Multitasking

Deadline management

Security & dependability

Vendor negotiation

Budgeting & tracking

Facilitation skills

Editorial skills

Global association experience

Education

Masters degree in Psychometrics, Educational Psychology, Psychology or equivalent

Job description

Paycom is seeking a Certification Exam Developer Specialist to lead development, updating, and performance monitoring of AMPP certification examinations. You will coordinate in-person and virtual SME meetings to ensure job-role alignment and defensible exam content.

The role emphasizes item writing, bank maintenance, and preparation of exams for production, with strong focus on exam security and quality control across multiple test forms. Travel may be required.