Test Developer – Medical Assessments & Exam Programs

Colorado Psychiatric; East Lansing, Northern (MI, KY); Hybrid; USD 85,000 - 110,000; Full time

Job summary

ABEM seeks a Test Developer to lead exam development, ensure content accuracy, and maintain high standards for medical assessments. You will manage item banks, collaborate with SMEs, and guide form development from blueprint to publication.

The role requires experience in testing, data analysis, and knowledge of measurement principles, with up to 15% travel and strong communication skills.

Qualifications

• Four-year degree and 3–5 years of relevant work experience in testing or a related field.
• Understanding of question writing and examination construction principles is required.
• Ability to learn medical terminology and analyze data to inform decisions.

Responsibilities

• Develops examination forms aligned with blueprints and selection criteria.
• Maintains item banks and conducts gap analyses for domain coverage.
• Guides SMEs through exam development stages including form assembly, publication, and validation.
• Coordinates exam development committee meetings and logistics with staff editors.
• Prepares materials for committee and Board reviews.
• Assists with onboarding and training of new SMEs; updates training materials.

Skills

Communication skills

Microsoft 365

Analytical thinking

Project coordination

Travel up to 15%

Education

Bachelor's degree

Tools

ExamDeveloper

Trello

Smartsheet

HubSpot

Job description

ABEM seeks a Test Developer to lead exam development, ensure content accuracy, and maintain high standards for medical assessments. You will manage item banks, collaborate with SMEs, and guide form development from blueprint to publication.

The role requires experience in testing, data analysis, and knowledge of measurement principles, with up to 15% travel and strong communication skills.