Assessment Innovation Manager

The Institute of Internal Auditors; Orlando (FL); Hybrid; USD 110,000 - 140,000; Full time

Job summary

The Institute of Internal Auditors (IIA) seeks a Manager of Assessment Development & Innovation to advance certification programs through rigorous test development practices. The role focuses on job task analysis, content creation, item review, and standard-setting to ensure exams are valid and defensible.

The candidate will also spearhead initiatives exploring new assessment methods and AI-powered item generation.

Qualifications

• Bachelor's degree in Psychology, Measurement, Education, or related field, or equivalent experience.
• 3–5+ years of assessment/test development, certification, or credentialing programs.
• Experience with job task analysis, item writing/review, and standard-setting methodologies.
• Strong facilitation skills guiding SME panels toward consensus.
• Excellent written communication for technical reports; proficient in survey design and data analysis using Excel.

Responsibilities

• Lead SME and stakeholder sessions throughout exam development lifecycle (JTA data gathering, item review, standard-setting).
• Develop interview protocols and conduct focus groups for JTA data collection.
• Design and implement JTA surveys to gather practitioner input at scale.
• Create PowerPoint materials and pre-meeting resources to support SME understanding of JTA and item review.
• Prepare data for standard-setting activities, including item-level statistics and rating materials.
• Manage end-to-end SME item curation, tracking, and quality control.
• Evaluate AI-generated exam items for accuracy, relevance, and alignment with content specs.
• Analyze survey and standard-setting data to validate tasks and knowledge statements.

Skills

Facilitation

Analytical thinking

Project management

Technical writing

Education

Bachelor's degree in Psychology, Measurement, Education, or related

Advanced degree preferred

Tools

Excel

Job description

The Institute of Internal Auditors (IIA) seeks a Manager of Assessment Development & Innovation to advance certification programs through rigorous test development practices. The role focuses on job task analysis, content creation, item review, and standard-setting to ensure exams are valid and defensible.

The candidate will also spearhead initiatives exploring new assessment methods and AI-powered item generation.