Remote Senior Director, Assessment & Strategy

Physician-Assistant-Education-Association; United States; Remote; USD 147,000 - 158,000; Full time

Benefits offered by this job

Remote work

Job summary

PA Education Association (PAEA) seeks a Senior Director, Assessment to lead the assessment portfolio, guide strategy, and drive continuous improvement. You will oversee psychometrics, exam development, and data-driven innovations while managing a remote, national team.

The role requires an 8+ year background in assessment with PhD-level credentials, strong leadership, and excellent communication skills to collaborate with executives and external partners. Competitive salary and benefits offered.

Qualifications

• Doctoral degree in Psychometrics, Educational Measurement, Quantitative Psychology, Educational Psychology, Statistics, Research Methodology, or closely related field.
• Minimum of 8 years of progressively responsible experience in assessment, psychometrics, educational measurement, testing, or related fields.
• Minimum of 3 years of supervisory or leadership experience managing professional staff and complex projects.
• Deep knowledge of Classical Test Theory, Item Response Theory, Rasch measurement, standard setting, test development, validation, scoring, equating, and assessment reporting.
• Demonstrated experience leading assessment programs, initiatives, or portfolios.
• Experience managing external vendors, consultants, and stakeholder relationships.
• Strong strategic planning, organizational leadership, and project management skills.
• Excellent written and verbal communication skills, including the ability to explain technical concepts to non-technical audiences.
• Ability to manage multiple priorities and lead complex cross-functional initiatives.
• Strong analytical, problem-solving, and decision-making skills.
• Demonstrated commitment to assessment quality, fairness, accessibility, and continuous improvement.

Responsibilities

• Lead the strategy, planning, implementation, evaluation, and continuous improvement of current and future assessment products and services.
• Monitor developments in educational measurement, psychometrics, assessment technology, artificial intelligence, and health professions education to identify opportunities for improvement.
• Collaborate with organizational leaders on assessment initiatives, business planning, and product development opportunities.
• Oversee the full assessment lifecycle, including blueprint development and evaluation, item banking, test construction, administration and delivery, scoring, scaling, equating, standard setting, reporting, quality assurance, and technical documentation.
• Ensure assessments are valid, reliable, fair, accessible, secure, and legally defensible, and establish related policies and procedures.
• Lead psychometric analyses and measurement research to support evidence-based decision-making.
• Guide the development and use of data tools, analytical solutions, and measurement technologies, and communicate findings to technical and nontechnical audiences.
• Supervise, coach, and mentor Assessment staff; manage performance; and foster alignment across psychometric, operational, and strategic functions.
• Oversee vendor performance and external partnerships; implement process improvements for quality, efficiency, and stakeholder experience.

Skills

Strategic leadership

Project management

Communication skills

Analytical thinking

Team leadership

Education

Doctoral degree in Psychometrics / Educational Measurement

Tools

R

Data visualization tools

Assessment platforms

Job description

PA Education Association (PAEA) seeks a Senior Director, Assessment to lead the assessment portfolio, guide strategy, and drive continuous improvement. You will oversee psychometrics, exam development, and data-driven innovations while managing a remote, national team.

The role requires an 8+ year background in assessment with PhD-level credentials, strong leadership, and excellent communication skills to collaborate with executives and external partners. Competitive salary and benefits offered.