Remote Senior Psychometrics & Efficacy Analyst (2-Year)

Khan Academy; San Mateo (CA); Hybrid; USD 138,000 - 155,000; Full time

Benefits offered by this job

Remote‑first culture

Generous parental leave

401(k) with 4% matching

Comprehensive insurance

Job summary

Khan Academy Kids is seeking a Senior Efficacy Research and Psychometrics Analyst to strengthen the evidence base behind assessments and learning content for PreK–2 learners. You will lead psychometric analyses and partner with external researchers while owning analytics and KPI dashboards for Khan Academy Kids.

The role requires advanced training in psychometrics or related fields, strong SQL skills, and experience with Looker; remote-friendly with a fixed-term 24 months.

Qualifications

• Advanced degree in psychometrics, educational measurement, quantitative methods or related field (or equivalent applied experience).
• Strong grounding in psychometric methods including item analysis, reliability and validity evidence, growth modeling, and IRT.
• Proficiency with SQL and a statistical language (R or Python) for data extraction, cleaning, analysis, and visualization.
• Experience with BI tools such as Looker and building dashboards and data pipelines.

Responsibilities

• Lead our psychometric research partnership: serve as technical contact for external partners, support study design, data sharing, analyses and interpretation.
• Extract, clean, and securely share assessment data with research partners on a recurring schedule.
• Analyze and interpret psychometric findings, including item difficulty, score distributions, growth analyses, and IRT-based scoring.
• Translate findings into product improvements (e.g., scoring models, discontinuation rules).
• Develop technical documentation, starting with the technical manual for our PreK assessment.
• Recruit and manage research partner sites, MOUs, consent procedures, and coordination of site visits.
• Draft and negotiate data-sharing agreements with districts and research organizations (pseudonymized/identified data).
• Coordinate efficacy studies and contribute to future study designs.
• Own Khan Kids KPI dashboard and analytics reporting; integrate with App Store Connect and Google Play Console.
• Prepare recurring app performance reporting; field ad hoc data requests; write targeted SQL queries.

Skills

SQL

Python

R

Data visualization

Communication

Project management

Cross-cultural competency

Data privacy awareness

Education

PhD or Master’s in psychometrics or related field

Tools

Looker

BI dashboards

Job description

Khan Academy Kids is seeking a Senior Efficacy Research and Psychometrics Analyst to strengthen the evidence base behind assessments and learning content for PreK–2 learners. You will lead psychometric analyses and partner with external researchers while owning analytics and KPI dashboards for Khan Academy Kids.

The role requires advanced training in psychometrics or related fields, strong SQL skills, and experience with Looker; remote-friendly with a fixed-term 24 months.