Certification Exam Architect (Remote/Hybrid)

Datamatics; United States; Hybrid; USD 90,000 - 130,000; Full time

Job summary

Datamatics is seeking an experienced Exam/Assessment Developer to design, develop, and manage certification exams. The role requires collaboration with SMEs to create valid, reliable assessments and adherence to industry best practices.

The candidate will conduct JTAs, develop blueprints, draft and review exam items, and coordinate with psychometric vendors to set passing scores while ensuring security and confidentiality of content.

Qualifications

• 4+ years of experience in exam development, educational assessment, certification, or related project management.
• Strong understanding of psychometric principles and the exam development lifecycle.
• Experience conducting Job Task Analysis (JTA) and developing exam objectives.
• Proven experience writing and reviewing multiple-choice assessment questions.
• Excellent stakeholder management and communication skills.
• Ability to manage virtual teams and coordinate with global SMEs.
• Strong project management skills with the ability to manage multiple priorities.
• Bachelor's or Master's degree in Psychometrics, Industrial & Organizational Psychology, Educational Assessment, Instructional Design, or equivalent.

Responsibilities

• Conduct Job Task Analysis (JTA) to identify knowledge, skills, and abilities for certification exams.
• Develop exam blueprints and test definition documents.
• Facilitate workshops with SMEs to create high-quality assessment content.
• Write, review, revise, and validate multiple-choice exam questions.
• Ensure assessment content aligns with psychometric principles and cognitive learning objectives.
• Coordinate technical reviews and maintain accuracy of exam content.
• Plan and execute beta exams and analyze candidate feedback.
• Work with psychometric vendors to perform statistical analysis, establish passing scores, and finalize exam items.
• Track project timelines and ensure timely delivery of exam development activities.
• Maintain confidentiality and security of assessment content.
• Manage exam content using item banking and assessment authoring tools.
• Collaborate with cross-functional stakeholders to improve the certification program.

Skills

Exam development

Psychometrics

Instructional design

Project management

Stakeholder management

Cross-functional collaboration

Education

Bachelor's or Master's degree in Psychometrics/OIN/Educational Assessment/Instructional Design

Tools

Microsoft Project

OmniPlan

Item Workshop

CERTS

Benchmark

Job description

Datamatics is seeking an experienced Exam/Assessment Developer to design, develop, and manage certification exams. The role requires collaboration with SMEs to create valid, reliable assessments and adherence to industry best practices.

The candidate will conduct JTAs, develop blueprints, draft and review exam items, and coordinate with psychometric vendors to set passing scores while ensuring security and confidentiality of content.