Director of Applied AI Research

edmentum; BLOOMINGTON (MN); Remote; USD 145,000 - 155,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) with company matching

Time away program

Volunteer time away

Winter office closure

Job summary

Edmentum is a remote-first educator and student-focused company seeking a Manager, Applied AI Research to lead a team producing evidence on AI-enabled features’ reliability, validity, and fairness. You will design studies, ensure rigorous validation, and translate findings into decisions for product and policy.

You will collaborate across Product, Technology, Learning and Assessment Design, and Efficacy Research to shape questions, set priorities, and deliver timely insights.

Qualifications

• Doctorate in psychometrics, quantitative psychology, educational measurement, statistics, data science, AI evaluation, or related field.
• 8+ years of experience in psychometric analysis, measurement science, AI research, data science, or related technical domains.
• 2-3 years of experience managing complex research projects and leading individuals or a small team.
• Designed or overseen research/validation approaches for AI-enabled features, automated scoring, or adjacent areas.
• Knowledge of AERA/NCME/APA Standards and AI policy landscape in education.

Responsibilities

• Lead a team of researchers producing evidence on reliability, validity, and fairness of Edmentum's AI-enabled features.
• Design and oversee research/validation approaches for automated scoring and AI capabilities.
• Represent Edmentum in academic, industry, standards-body, customer, and policy-facing forums.
• Partner with Product Management, Technology, Learning and Assessment Design, and Efficacy Research to shape questions and deliver timely answers.
• Hire, coach, and develop researchers and build a growing team.
• Manage university and third-party research partnerships and uphold high standards for quality and ethics.

Skills

AI research leadership

Psychometric analysis

Research project management

External collaborations

Communicating complex findings

Education

Doctorate in psychometrics or related field

Job description

Edmentum is a remote-first educator and student-focused company seeking a Manager, Applied AI Research to lead a team producing evidence on AI-enabled features’ reliability, validity, and fairness. You will design studies, ensure rigorous validation, and translate findings into decisions for product and policy.

You will collaborate across Product, Technology, Learning and Assessment Design, and Efficacy Research to shape questions, set priorities, and deliver timely insights.