Medical Assessment Test Lead

Embarcaderomediagroup; Lansing (MI); On-site; USD 60,000 - 90,000; Full time

Job summary

ABEM is seeking a Test Developer to draft exams, conduct quality control, and ensure the accuracy and integrity of medical assessments throughout development and production. You will lead SME coordination, maintain item banks, develop examination forms, and collaborate with psychometricians on scoring, validation, and policy documentation.

The role requires a four-year degree, 3–5 years in testing or related work, strong communication, proficiency with Microsoft 365, and willingness to travel up

Qualifications

• Four-year degree and 3–5 years of relevant work experience in testing or a related field.
• At least two years of program or project management experience.
• Understanding of question writing and examination construction principles.
• Understanding of measurement principles.
• Ability to collect and analyze data to inform decisions.
• Ability to learn medical terminology.
• Proficiency with Microsoft 365 (Excel, PowerPoint, SharePoint, Word).
• Strong oral and written communication skills.
• Strong problem-solving and critical-thinking skills.
• Maintains professionalism and confidentiality about sensitive matters and organizational information.
• Ability to collaborate with teams for continuous quality improvement.
• Familiarity with web-based item banking apps (e.g., ExamDeveloper), test delivery platforms, and PM software (Trello, Smartsheet, HubSpot).
• Ability to travel up to 15%.

Responsibilities

• Guides examination programs by developing, updating, and coordinating schedules for SMEs with staff editors.
• Maintains item banks and conducts gap analyses to cover blueprints.
• Develops examination forms aligned with blueprints and selection criteria; works with psychometricians on parameters and linkages.
• Guides SMEs through form assembly, publication, and validation processes.
• Organizes exam development committee meetings and logistics with staff editors.
• Prepares materials for committee, task force, and Board reviews.
• Onboards and trains new SMEs, developing training materials with staff editors.
• Maintains relationships with committee members and staff to achieve outcomes.
• Offers test development expertise and promotes best practices.
• Prepares and updates standard policies and procedures for test development.
• Collaborates with psychometricians on scoring tasks and other test projects.
• Develops and maintains test development reports for stakeholders.
• Provides technical support for testing applications and software updates.
• Plans annual Item Writers Workshop and provides on-site support.
• Staffs case development meetings and supports case teams between meetings.
• Documents item/case development processes and identifies improvement opportunities.
• Represents ABEM to stakeholders and professional audiences.
• Staffs certification administrations and related meetings.

Skills

Project management

Data analysis

Communication

Problem solving

Collaboration

Confidentiality

Medical terminology

Education

Bachelor's degree

Tools

ExamDeveloper

Trello

Smartsheet

HubSpot

Microsoft 365

Job description

ABEM is seeking a Test Developer to draft exams, conduct quality control, and ensure the accuracy and integrity of medical assessments throughout development and production. You will lead SME coordination, maintain item banks, develop examination forms, and collaborate with psychometricians on scoring, validation, and policy documentation.

The role requires a four-year degree, 3–5 years in testing or related work, strong communication, proficiency with Microsoft 365, and willingness to travel up