Exam/Assessment Developer

Datamatics; United States; Hybrid; USD 90,000 - 130,000; Full time

Job summary

Datamatics is seeking an experienced Exam/Assessment Developer to design, develop, and manage certification exams. The role requires collaboration with SMEs to create valid, reliable assessments and adherence to industry best practices.

The candidate will conduct JTAs, develop blueprints, draft and review exam items, and coordinate with psychometric vendors to set passing scores while ensuring security and confidentiality of content.

Qualifications

• 4+ years of experience in exam development, educational assessment, certification, or related project management.
• Strong understanding of psychometric principles and the exam development lifecycle.
• Experience conducting Job Task Analysis (JTA) and developing exam objectives.
• Proven experience writing and reviewing multiple-choice assessment questions.
• Excellent stakeholder management and communication skills.
• Ability to manage virtual teams and coordinate with global SMEs.
• Strong project management skills with the ability to manage multiple priorities.
• Bachelor's or Master's degree in Psychometrics, Industrial & Organizational Psychology, Educational Assessment, Instructional Design, or equivalent.

Responsibilities

• Conduct Job Task Analysis (JTA) to identify knowledge, skills, and abilities for certification exams.
• Develop exam blueprints and test definition documents.
• Facilitate workshops with SMEs to create high-quality assessment content.
• Write, review, revise, and validate multiple-choice exam questions.
• Ensure assessment content aligns with psychometric principles and cognitive learning objectives.
• Coordinate technical reviews and maintain accuracy of exam content.
• Plan and execute beta exams and analyze candidate feedback.
• Work with psychometric vendors to perform statistical analysis, establish passing scores, and finalize exam items.
• Track project timelines and ensure timely delivery of exam development activities.
• Maintain confidentiality and security of assessment content.
• Manage exam content using item banking and assessment authoring tools.
• Collaborate with cross-functional stakeholders to improve the certification program.

Skills

Exam development

Psychometrics

Instructional design

Project management

Stakeholder management

Cross-functional collaboration

Education

Bachelor's or Master's degree in Psychometrics/OIN/Educational Assessment/Instructional Design

Tools

Microsoft Project

OmniPlan

Item Workshop

CERTS

Benchmark

Job description

Job Title: Exam/Assessment Developer

Experience: 4+ Years

Location: Hybrid/Remote
Employment Type: Full-Time

Shift: US Shift

Job Summary

We are looking for an experienced Exam/Assessment Developer to design, develop, and manage certification and assessment exams. The ideal candidate will possess strong expertise in exam development methodologies, psychometrics, instructional design, and project management. This role involves collaborating with Subject Matter Experts (SMEs) to create valid, reliable, and legally defensible assessments while ensuring adherence to industry best practices.

Key Responsibilities

• Conduct Job Task Analysis (JTA) to identify knowledge, skills, and abilities required for certification exams.
• Develop exam blueprints and test definition documents.
• Facilitate workshops with Subject Matter Experts (SMEs) to create high-quality assessment content.
• Write, review, revise, and validate multiple-choice exam questions.
• Ensure assessment content aligns with psychometric principles and cognitive learning objectives.
• Coordinate technical reviews and maintain the accuracy and relevance of exam content.
• Plan and execute beta exams and analyze candidate feedback.
• Work with psychometric vendors to perform statistical analysis, establish passing scores, and finalize exam items.
• Track project timelines and ensure timely delivery of assigned exam development activities.
• Maintain confidentiality and security of assessment content.
• Manage exam content using item banking and assessment authoring tools.
• Collaborate with cross-functional stakeholders to continuously improve the certification program.

Required Skills & Qualifications

• 4+ years of experience in exam development, educational assessment, certification, or related project management.
• Strong understanding of psychometric principles and the exam development lifecycle.
• Experience conducting Job Task Analysis (JTA) and developing exam objectives.
• Proven experience writing and reviewing multiple-choice assessment questions.
• Excellent stakeholder management and communication skills.
• Ability to manage virtual teams and coordinate with global SMEs.
• Strong project management skills with the ability to manage multiple priorities.
• Bachelor's or Master's degree in:
  • Psychometrics
  • Industrial & Organizational Psychology
  • Educational Assessment
  • Instructional Design
  • Or an equivalent discipline.

Preferred Qualifications

• Experience in IT or Software Certification programs.
• Familiarity with Microsoft Project, OmniPlan, or similar project management tools.
• Experience using assessment authoring or item banking tools (e.g., Item Workshop, CERTS, Benchmark).
• Knowledge of standard-setting methodologies such as Modified Angoff or Hofstee.
• Experience designing assessments for technical or soft skills.

Key Competencies

• Assessment Design
• Psychometrics
• Instructional Design
• Certification Development
• Project Management
• Stakeholder Management
• Content Review & Validation
• Analytical Thinking
• Communication & Collaboration