Chief Assessment & AI Strategy Leader

Nonprofit HR

Raleigh (NC)

Hybrid

USD 180,000 - 240,000

Full time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

The American Board of Anesthesiology (ABA) seeks a Chief Assessment Officer to lead the science, strategy, and innovation behind its assessment, credentialing, and certification programs in Raleigh, NC. This executive leader will oversee 33 staff and drive a digital-first, AI-enabled assessment ecosystem while maintaining rigorous measurement standards.

Ideal candidates hold a doctoral degree in a relevant field, 10+ years in high-stakes assessment leadership, and a track record of

Qualifications

  • Doctoral degree in Educational Measurement, Psychometrics, Educational Psychology, or related field.
  • 10+ years of progressively responsible leadership in assessment, credentialing, or related area.
  • Executive leadership experience with high-stakes assessment programs and data-driven decisions.

Responsibilities

  • Lead enterprise strategy and innovation across certification models and assessment programs.
  • Oversee full assessment lifecycle: design, development, administration, psychometrics, scoring, reporting.
  • Direct credentialing, continuing certification, and diplomate services integration with operations.
  • Advance validation, research, and measurement science to inform decisions.
  • Guide technology strategy, AI governance, and digital product development for assessments.
  • Manage budgets, vendor relationships, and scalable delivery of programs.
  • Develop leaders, foster collaboration, and promote a culture of inclusion and continuous learning.

Skills

Executive leadership
Psychometrics
Assessment design
Research methods
Strategic planning
Financial management
Stakeholder communication
Team leadership
AI in assessment
Analytics

Education

Doctoral degree in Educational Measurement / Psychometrics / related field

Tools

AI in assessment
Advanced analytics
Emerging assessment technologies

Job description

The American Board of Anesthesiology (ABA) seeks a Chief Assessment Officer to lead the science, strategy, and innovation behind its assessment, credentialing, and certification programs in Raleigh, NC. This executive leader will oversee 33 staff and drive a digital-first, AI-enabled assessment ecosystem while maintaining rigorous measurement standards.

Ideal candidates hold a doctoral degree in a relevant field, 10+ years in high-stakes assessment leadership, and a track record of

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Chief Assessment Officer: Innovation in Psychometrics & Certification
Chief Assessment Officer: Innovation in Psychometrics & Certification

The American Board of Anesthesiology • Raleigh (NC)

Hybrid
USD 180,000 - 240,000
Chief Assessment Officer
Chief Assessment Officer

The American Board of Anesthesiology • Raleigh (NC)

Hybrid
USD 180,000 - 240,000
Chief Assessment Officer (The ABA)
Chief Assessment Officer (The ABA)

Nonprofit HR • Raleigh (NC)

Hybrid
USD 180,000 - 240,000
Senior Director, Assessment Strategy & Psychometrics
Senior Director, Assessment Strategy & Psychometrics

TrulyHired • Massachusetts

On-site
USD 164,000 - 197,000
401k with company match
Paid holidays
Flexible vacation policy
Regional Chief Medical Officer — AI Care Leader
Regional Chief Medical Officer — AI Care Leader

Heidi • United States

Remote
USD 350,000 - 600,000
Remote Director of AI Healthcare Assurance & Accreditation
Remote Director of AI Healthcare Assurance & Accreditation

AAPC • Salt Lake City (UT)

On-site
USD 90,000 - 120,000
Competitive salary and benefits package
Flexible, remote work environment
Professional development and growth opportunities
ABA Clinical Director: Lead & Grow High-Impact Therapy
ABA Clinical Director: Lead & Grow High-Impact Therapy

Action Behavior Centers - ABA Therapy for Autism • Pineville (NC)

Hybrid
USD 90,000 - 117,000
401k with Company Match
Relocation packages available
Health benefits
+7
Director, AI Accreditation & Assurance Programs
Director, AI Accreditation & Assurance Programs

AAPC • Salt Lake City (UT)

On-site
USD 90,000 - 120,000
Competitive salary and benefits package
Flexible, remote work environment
Professional development and growth opportunities
AI Strategy Lead — ROI & Change Management (NYC)
AI Strategy Lead — ROI & Change Management (NYC)

Tenex • New York (NY)

On-site
USD 100,000 - 200,000
Ownership of contributions
Working in-office in NYC
Joining a world-class team
Exam Operations & Data Strategy Manager
Exam Operations & Data Strategy Manager

Accentuate Staffing • Raleigh (NC)

On-site
USD 90,000 - 120,000