Senior Efficacy Research and Psychometrics Analyst, Khan Kids (24 months fixed-term)
Khan Academy
Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
Benefits offered by this job
Job summary
Khan Academy Kids seeks a Senior Efficacy Research and Psychometrics Analyst (24 months) to strengthen evidence behind assessments for PreK–2 learners. You will lead external partnerships, coordinate data sharing, and advance scoring models and reporting to inform product and partnerships.
The role requires a strong background in psychometrics, data privacy, and BI tools, with the ability to translate findings for product teams and funders. Remote-friendly, US-based candidates preferred.
Qualifications
- Advanced degree in psychometrics or related field, or equivalent experience.
- Strong grounding in item analysis, reliability/validity, growth modeling, IRT.
Responsibilities
- Lead psychometric research partnership: study design, data sharing, analyses, interpretation.
- Extract, clean, securely share data with research partners on schedule.
- Analyze psychometric findings: item difficulty, score distributions, growth, validity.
- Collaborate with product/engineering to translate findings into scoring models and rules.
- Develop technical docs for PreK assessment with partners.
- Recruit and onboard school/district sites; coordinate MOUs and consent.
- Draft data-sharing agreements; manage pseudonymized and identified data.
- Coordinate ongoing efficacy studies and stakeholder alignment.
- Own Khan Kids KPI dashboard with engineering for analytics integrations.
- Prepare recurring app performance reporting and ad hoc SQL queries.
Skills
Education
Tools
Job description
We have seen a rise in recruitment scams. Please note that outreach from Khan Academy recruiters will only come from the @khanacademy.org domain. Our team does not use Gmail or other personal accounts for contacting potential candidates. Khan Academy will never solicit money, equipment fees, or sensitive financial information at any stage of the hiring process. We also do not work with external recruiting agencies, so outreach from headhunters presenting opportunities on behalf of Khan Academy is illegitimate. Please always check the email domain and cross-reference the position with the official Khan Academy Careers page to confirm an opening is valid.
Khan Academy is a nonprofit with the mission to deliver a free, world-class education to anyone, anywhere. Our proven learning platform offers free, high-quality supplemental learning content and practice that cover Pre-K - 12th grade and early college core academic subjects, focusing on math and science. We have over 181 million registered learners globally and are committed to improving learning outcomes for students worldwide, focusing on learners in historically under-resourced communities.
Khan Academy Kids is a free and fun learning program for children ages 2 to 8. Kodi Bear and a cast of animated characters lead children on a personalized education journey filled with fun, standards-aligned activities in early literacy, math, executive functioning and social emotional skills. Built by a small but mighty team, Khan Academy Kids is used by millions of children in homes and classrooms around the world.
Our students, teachers, and parents come from all walks of life, and so do we. Our team includes people from academia, traditional/non-traditional education, big tech companies, and tiny startups. We hire great people from diverse backgrounds and experiences because it makes our company stronger. We value diversity, equity, inclusion, and belonging as necessary to achieve our mission and impact the communities we serve. We know that transforming education starts in-house with learning about ourselves and our colleagues. We strive to be world-class in investing in our people and commit to developing you as a professional.
Khan Academy Kids is looking for a Senior Efficacy Research and Psychometrics Analyst (24 months fixed-term) to strengthen the evidence base behind our assessments and learning content for children in PreK through 2nd grade.
Responsibilities:
- Lead our psychometric research partnership: Serve as the primary technical point of contact for our external psychometric research partnership, supporting study design, data sharing, psychometric analyses, and interpretation of findings
- Extract, clean, and securely share assessment data with research partners on a recurring schedule
- Analyze and interpret psychometric findings, including item difficulty, score distributions, growth analyses, concurrent validity, and IRT-based scoring
- Partner with our product and engineering teams to translate findings into product improvements, such as updates to scoring models and assessment discontinuation rules
- Collaborate with research partners to develop and publish technical documentation, beginning with the technical manual for our PreK assessment
- Recruit and manage research partner sites: Recruit and onboard school and district sites for psychometric and efficacy studies; execute MOUs; align on consent procedures and participant incentives; and coordinate site visits for direct child assessment data collection
- Partner with our legal team to draft and negotiate data-sharing agreements with districts and research organizations, including requirements for pseudonymized and identified data
- Support efficacy research. Coordinate Khan Academy Kids' participation in ongoing efficacy studies and contribute to the design of future studies, aligning internal and external stakeholders on the research approach
- Own Khan Kids’s KPI dashboard: Partner with our engineering team to build and maintain the Khan Academy Kids analytics dashboard, including integrations with App Store Connect and Google Play Console. Maintain the dashboard so it can be used by other teams including marketing, school partnerships, and philanthropy.
- Lead recurring reporting: Prepare recurring app performance reporting, including monthly and quarterly business reviews and periodic target setting. Field ad hoc data requests across teams — for example, writing new SQL queries to support targeted district outreach or grant reporting.
- An advanced degree (PhD or Master's) in psychometrics, educational measurement, quantitative methods or a related field — or equivalent applied experience
- Strong grounding in psychometric methods, including item analysis, reliability and validity evidence, growth modeling, and Item Response Theory (IRT)
- Proficiency with SQL and a statistical programming language (e.g., R or Python) for extracting, cleaning, analyzing, and visualizing data
- Experience with (or eagerness to learn) business intelligence tools such as Looker, and comfort building dashboards and data pipelines
- Familiarity with responsible data-sharing practices in education research, including student data privacy considerations (e.g., FERPA, COPPA) and work with pseudonymized and deidentified data
- Excellent communication skills: able to translate complex psychometric findings into clear implications for product teams, funders, and school partners
- Strong project-management and organizational skills, with the ability to coordinate multiple external partners, recurring deliverables, and data-sharing schedules with close attention to detail
- Proven cross-cultural competency skills, demonstrating self-awareness, awareness of others, and the ability to adopt inclusive perspectives, attitudes, and behaviors to drive inclusion and belonging throughout the organization
- Motivated by Khan Academy’s mission “to provide a free, world-class education for anyone, anywhere”
- Experience with (or strong interest in) early childhood education and assessment of young learners is a plus
We may be a non-profit, but we reward our talented team extremely well! We offer:
- Competitive salaries
- Ample paid time off as needed – Your well-being is a priority
- 8 pre-scheduled Wellness Days in 2026 occurring on a Monday or a Friday for a 3-day weekend boost
- Remote-first culture - that caters to your time zone, with open flexibility as needed, at times
- Generous parental leave
- An exceptional team that trusts you and gives you the freedom to do your best
- The chance to put your talents towards a deeply meaningful mission and the opportunity to work on high-impact products that are already defining the future of education
- Opportunities to connect through affinity, ally, and social groups
- And we offer all those other typical benefits as well: 401(k) + 4% matching & comprehensive insurance, including medical, dental, vision, and life
At Khan Academy we are committed to fair and equitable compensation practices, the well-being of our employees, and our Khan community. This belief is why we have built out a robust Total Rewards package that includes competitive base salaries, and extensive benefits and perks to support physical, mental, and financial well-being. The compensation band for this role is $137,871 - $155,105 USD annually for candidates based in the United States and $186,306 - $209,595 CAD annually for candidates based in Canada. The pay range for this position is a general guideline only. The salary offered will depend on internal pay equity and the candidate’s relevant skills, experience, qualifications, and job market data.
- Sal’s TED talk from 2011
- Sal’s TED talk from 2015
- Sal's TED talk from 2023
- Our team: http://www.khanacademy.org/about/the-team
We deeply understand and empathize with our users. We leverage user insights, research, and experience to build content, products, services, and experiences that our users trust and love. Our success is defined by the success of our learners and educators.
As a company, we have conviction in our aspirational point of view of how education will evolve. The work we do is in service to moving towards that point of view. However, we also listen, learn and flex in the face of new data, and commit to evolving this point of view as the industry and our users evolve.
We are a diverse community. We seek out and embrace a diversity of voices, perspectives and life experiences leading to stronger, more inclusive teams and better outcomes. As individuals, we are committed to bringing up tough topics and leaning into different points of view with curiosity. We actively listen, learn and collaborate to gain a shared understanding. When a decision is made, we commit to moving forward as a united team.
We understand that achieving our audacious mission is a marathon, so we set realistic timelines and we focus on delivery that also links to the bigger picture. As a non-profit, we are supported by the generosity of donors as well as strategic partners, and understand our responsibility to our finite resources. We spend every dollar as though it were our own. We are responsible for the impact we have on the world and to each other. We ensure our team and company stay healthy and financially sustainable.
We are committed to making learning a joyful process. This informs what we build for our users and the culture we co-create with our teammates, partners and donors.
We believe in the power of growth for learners and for ourselves. We constantly learn and teach to improve our offerings, ourselves, and our organization. We learn from our mistakes and aren’t afraid to fail. We don't let past failures or successes stop us from taking future bold action and achieving our goals.
We insist on high standards and deliver delightful, effective end-to-end experiences that our users can rely on. We choose to focus on fewer things — each of which aligns to our ambitious vision — so we can deliver high-quality experiences that accelerate positive measurable learning with our strategic partners.
We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, gender, gender identity or expression, national origin, sexual orientation, age, citizenship, marital status, disability, or Veteran status. We value diversity, equity, and inclusion, and we encourage candidates from historically underrepresented groups to apply.
As part of this commitment, Khan Academy will ensure that persons with disabilities are provided reasonable accommodations for the hiring process. If reasonable accommodation is needed, please contact careers@khanacademy.org
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
