Medical Assessment Exam Developer

American Board of Emergency Medicine; East Lansing (MI); On-site; USD 90,000 - 130,000; Full time

Job summary

American Board of Emergency Medicine is seeking a Test Developer to guide examination programs through development and production, ensuring high content quality and compliance. You will manage SME collaboration, form development, and psychometric coordination to maintain rigorous standards.

The role emphasizes cross-functional teamwork, process improvement, and ongoing training of SMEs, with on-site activities and stakeholder engagement across ABEM’s programs.

Qualifications

• Four-year degree and three to five years of relevant work experience in testing or a related field.
• At least two years of program or project management experience is required; five years is preferred.
• Understanding of question writing and examination construction principles is preferred.
• Understanding of measurement principles.
• Ability to collect and analyze data to inform decisions.
• Ability to learn medical terminology.
• Proficiency with Microsoft 365 (e.g., Excel, PowerPoint, SharePoint, Word); advanced Excel skills are preferred.
• Strong oral and written communication skills.
• Strong problem-solving and critical-thinking skills, and the ability to exercise sound judgement and make decisions based on accurate and timely analysis.
• Must maintain a high level of professionalism and confidentiality about sensitive matters and all organizational information.
• Ability to collaborate with individuals and teams in pursuit of continuous quality improvement.
• Ability to use web-based item banking applications (e.g., ExamDeveloper), test delivery platforms, and project management software (e.g., Trello, Smartsheet, HubSpot).
• Ability to travel up to 15% percent of the time.

Responsibilities

• Guides multiple examination programs by developing, updating, and coordinating project schedules and assignments for SMEs in collaboration with staff editors.
• Maintains item banks for multiple examination programs using standardized processes, conducting gap analyses to ensure coverage.
• Develops examination forms for assigned programs, aligning with blueprints and selection criteria; works with psychometricians.
• Guides SMEs through stages of exam development, including form assembly, publication, validation, and post-exam reviews.
• Organizes and guides exam development committee meetings and related logistics with editors.
• Prepares materials for committee, task force, and Board review.
• Assists with onboarding and training of new SMEs with materials in collaboration with editors.
• Fosters relationships with committee members and staff to achieve outcomes.
• Offers test development expertise to ensure quality and best practices.
• Contributes to policies and procedures for test development activities.
• Consults with psychometricians for scoring tasks and related projects.
• Develops and maintains test development reports for stakeholders.
• Provides technical support for testing applications and software updates.
• Participates in Item Writers Workshop planning and on-site support with SMEs.
• Staffs case development meetings and supports case development teams between meetings.
• Maintains documentation of item/case development and exam processes for improvements.
• Collaborates in problem-solving and addressing issues as they arise.
• Represents ABEM in presentations to stakeholders and professional audiences.
• Staffs certification exam administrations and related meetings.

Skills

Program/Project management

Communication skills

Analytical ability

Collaboration

Confidentiality

Travel readiness

Education

Four-year degree

Tools

ExamDeveloper

Trello

Smartsheet

HubSpot

Microsoft 365

Excel

PowerPoint

SharePoint

Word

Job description

American Board of Emergency Medicine is seeking a Test Developer to guide examination programs through development and production, ensuring high content quality and compliance. You will manage SME collaboration, form development, and psychometric coordination to maintain rigorous standards.

The role emphasizes cross-functional teamwork, process improvement, and ongoing training of SMEs, with on-site activities and stakeholder engagement across ABEM’s programs.