Applied Research Lead, AI for Teaching

SLAC; Palo Alto (CA); On-site; USD 120,000 - 180,000; Full time

Job summary

Stanford University EduNLP Lab in Palo Alto seeks a partner-embedded researcher to design studies, translate research measures into product-ready evaluators, and study translation processes for scalable deployment. You will collaborate with edtech partners, lead multidisciplinary teams, supervise graduate researchers, and publish findings at ACL and Learning@Scale.

This role emphasizes rigorous experimental design, data pipelines, and collaboration with product teams to bring research into real

Qualifications

• Graduate degree in applicable social science with five years of related experience.
• Strong analytical skills and ability to work under deadlines.
• Experience with product teams or external partners to apply research.

Responsibilities

• Scope joint projects with edtech partners and translate research measures into product specifications.
• Design experiments including A/B tests and quasi-experiments with power analyses.
• Lead multidisciplinary teams spanning lab and partners’ product/engineering groups.
• Build and maintain data pipelines from data-use agreements to storage and organization.

Skills

Python

Data analysis

NLP pipelines

LLMs

Experiment design

Education

Graduate degree in social science

PhD preferred

Tools

?

Job description

About the lab

The EduNLP Lab at Stanford develops natural language processing methods and tools that support equitable, student-centered teaching. We build measures of what teachers and students say and do, such as how students reason aloud in small groups, how teachers respond to student ideas, and how teachers adapt curriculum. We use those measures both as research outcomes and as feedback teachers can act on. Our work has been deployed and tested at scale with edtech partners; for example, automated feedback on teachers’ questioning, delivered through a partner product, improved questioning quality in brick-and-mortar classrooms.

This position is part of Teacher CoPilots II, a multi-year research program in partnership with the AI Teaching Assistant strand of Stanford SCALE’s AI Hub for Education. The program studies where and how much AI support strengthens teachers’ decision-making while preserving their skill, and releases measures, benchmarks, evaluators, and protocols as public goods.

About the role

Research has the most impact when it reaches the products teachers use, and studying those products in real classrooms produces some of the most informative research. This role sits at that intersection. You will work with edtech partners, such as Coteach and Amplify, to bring the lab’s measures, evaluators, and feature concepts into their products; design and run the studies that test them; and publish what you learn. You will also help us study the translation process itself: what it takes for research tools to become product features that scale sustainably.

You will work closely with the lab’s project manager, who leads our educator and district partnerships, and with technical staff, postdocs, and graduate students who build and validate models. You do not need to be a machine learning engineer, but you do need to be fluent enough to work directly with data and with partners’ engineering teams.

Position Summary

Partner-embedded research

• Scope joint projects with edtech partners, matching each one to a research question and a feasible study.
• Balancing between different pacing, metrics, and level of agility across stakeholders
• Translate between product and research needs: turn research measures into specifications, evaluation harnesses, or prototypes that product teams can integrate, and turn product questions into testable designs.
• Lead multidisciplinary teams that span the lab and partners’ product and engineering teams.
• Build and maintain data pipelines from data use agreements to transfer, storage, and organization of data.

Study design, analysis, and writing

• Collaborate with the principal investigator to design the research approach for each partner study, and integrate results across studies.
• Design experiments in settings with few precedents, such as in-product A/B tests and randomized or quasi-experimental studies, including power analyses and preregistration.
• Independently select approaches for developing, testing, and evaluating new methods, including LLM-based evaluators and measures used inside products.
• Analyze outcomes for teacher practice and student learning using the lab’s validated measures.
• Lead and co-author peer-reviewed papers (e.g., ACL, Learning@Scale, LAK, education research journals) and briefs for practitioners and developers, and present findings at academic conferences.
  

Implementation science, public goods, and team

• Document each partnership systematically, recording what was asked, what changed, what shipped, and what got in the way, and use these records to lead cross-case research on moving research into products.
  Prepare documentation and usage guides so other developers can adopt the lab’s released measures, evaluators, and toolkits, and contribute to dissemination.
• Formally supervise and train graduate and undergraduate research assistants on partner-facing projects, including hiring, performance management, and instruction on techniques.
• Complete project-related administrative and budgetary responsibilities of limited scope, such as tracking partner deliverables and coordinating data-use agreements with the project manager.
• Other duties may also be assigned.
  

To be successful in this position, you will bring

Minimum education and experience (required)

Graduate degree in an applicable social science related field and five years of applicable experience, or combination of education and relevant experience in an applicable social science. Relevant fields include education, learning sciences, education data science, economics, statistics, and computational social science.

Minimum knowledge, skills, and abilities (required)

• Expert level knowledge and skills in field of science related to our lab’s work.
• General computer skills and ability to quickly learn and master computer programs.
• Strong analytical skills and excellent judgment.
• Ability to work under deadlines with general guidance.
• Excellent organizational skills and demonstrated ability to complete detailed work accurately.
• Demonstrated oral and written communication skills.
• Ability to work with human study participants.
• Supervisory skills.
  

Also required for this role

• At least two years of your applicable experience at a technology company, ideally in education technology.
• Strong Python skills and experience analyzing large, messy, real-world data, such as product logs, text, or interaction data.
• Hands-on experience with large language models or NLP pipelines, including prompting, evaluation, and working through APIs.
• Experience designing and analyzing experiments or quasi-experiments.
• A record of research writing, such as papers, technical reports, or major contributions to either.
• Experience working with product teams or external partners to put research into use, including scoping shared work and following through.

Preferred

• K–12 teaching experience, especially in mathematics, or familiarity with high-quality instructional materials such as Illustrative Mathematics.
• A PhD in a relevant field.
• NLP or machine learning research experience.
• Familiarity with implementation science, improvement science, or research–practice partnerships, and with research data governance (data-use agreements, IRB).
• Experience working with multilingual learners, or proficiency in Spanish.

If you meet the required qualifications but not every preferred one, we encourage you to apply. People reach this work by many routes, for example from the classroom into edtech or from research into product, and we value that range.

Physical requirements

Frequently perform desk-based computer tasks, grasp lightly/fine manipulation, lift/carry/push/pull objects that weigh up to 10 pounds.

Occasionally stand/walk, sit, use a telephone, writing by hand, and sort/file paperwork or parts.

Rarely twist/bend/stoop/squat, kneel/crawl, rarely reach/work above shoulders, operate foot and/or hand controls.

Working conditions

May be exposed to blood borne pathogens.

May be required to work non-standard, extended or weekend hours in support of research work.

Work standards

Interpersonal Skills: Demonstrates the ability to work well with Stanford colleagues and clients and with external organizations.

Promote Culture of Safety: Demonstrates commitment to personal responsibility and value for safety; communicates safety concerns; uses and promotes safe behaviors based on training and lessons learned.

Subject to and expected to comply with all applicable University policies and procedures, including but not limited to the personnel policies and other policies found in the University’s Administrative Guide, http://adminguide.stanford.edu/.