Chief Assessment Officer: Innovation in Psychometrics & Certification

The American Board of Anesthesiology; Raleigh (NC); Hybrid; USD 180,000 - 240,000; Full time

Job summary

The American Board of Anesthesiology (ABA) seeks a Chief Assessment Officer to lead the science, strategy, and innovation behind its assessment portfolio. This executive will guide 33 staff across Assessment Development, Psychometrics and Research, Credentialing, and Assessment Delivery.

The role focuses on digital-first assessment, AI integration, and high-quality patient care, reporting to the Executive Director with a hybrid schedule in Raleigh.

Qualifications

• A doctoral degree in Educational Measurement, Psychometrics, Educational Psychology, or a closely related field.
• At least 10 years of progressively responsible leadership in assessment, credentialing, or a related field.
• Executive leadership experience overseeing high-stakes assessment programs with psychometric expertise.
• Experience leading multidisciplinary teams and significant organizational transformation.
• Experience partnering with technology teams to advance assessment platforms and AI.
• Strong strategic, financial management, and communication capabilities.

Responsibilities

• Oversee the complete assessment lifecycle from design to reporting.
• Lead credentialing and continuing certification initiatives integrated with assessment strategy.
• Direct validation and research efforts to evaluate program effectiveness.
• Collaborate with technology teams on platform requirements and governance for AI in assessment.

Skills

Psychometrics

Executive leadership

Assessment design

Statistical methodologies

Strategic thinking

Communication

Education

Doctoral degree in Educational Measurement or related discipline

Job description

The American Board of Anesthesiology (ABA) seeks a Chief Assessment Officer to lead the science, strategy, and innovation behind its assessment portfolio. This executive will guide 33 staff across Assessment Development, Psychometrics and Research, Credentialing, and Assessment Delivery.

The role focuses on digital-first assessment, AI integration, and high-quality patient care, reporting to the Executive Director with a hybrid schedule in Raleigh.