Remote Technical PM: Pedagogy & AI Quality

TrulyHired

United States

Remote

USD 130,000 - 150,000

Full time

6 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Medley Learning is hiring a Technical Product Manager, Pedagogy & AI Quality to ensure AI-powered scaffolds meet high quality standards for multilingual learners and students with diverse needs.

You will define quality, expand eval systems, and collaborate with engineers to ship improvements. The role blends pedagogy with AI product work and requires strong writing and stakeholder communication.

Qualifications

  • Pedagogical expertise in scaffolding literacy for multilingual learners and special education.
  • Hands-on AI evals experience including human labeling and rubrics.
  • Experience designing AI-enabled products and daily use of LLMs.
  • Ability to define new features and communicate tradeoffs with engineers.
  • Strong initiative and clear writing for data-driven decisions.

Responsibilities

  • Define what excellent quality looks like for Medley scaffolds and set AI output quality targets.
  • Build and maintain eval datasets, rubrics, and trace/error analysis processes.
  • Write, test and refine prompts; run model comparisons and regression tests.
  • Regularly collect user signals and conduct research with educators and students to inform decisions.
  • Prioritize and ship AI quality improvements; write specs and coordinate with engineering.

Skills

Pedagogical expertise
AI evals experience
AI product fluency
Feature scoping with engineers
Clear writing and initiative

Education

Graduate degree in education or related field

Job description

Medley Learning is hiring a Technical Product Manager, Pedagogy & AI Quality to ensure AI-powered scaffolds meet high quality standards for multilingual learners and students with diverse needs.

You will define quality, expand eval systems, and collaborate with engineers to ship improvements. The role blends pedagogy with AI product work and requires strong writing and stakeholder communication.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Quality & Pedagogy PM for Multilingual Learners
AI Quality & Pedagogy PM for Multilingual Learners

Workshop Hiring • Boston (MA)

Hybrid
USD 120,000 - 180,000
AI-Pedagogy Quality Product Manager
AI-Pedagogy Quality Product Manager

Workshop Hiring • United States

Hybrid
USD 90,000 - 120,000
AI Quality & Pedagogy Product Manager — Multilingual Literacy
AI Quality & Pedagogy Product Manager — Multilingual Literacy

Workshop Venture Partners • Boston (MA)

Hybrid
USD 130,000 - 150,000
Technical Product Manager, Pedagogy & AI Quality
Technical Product Manager, Pedagogy & AI Quality

TrulyHired • United States

Remote
USD 130,000 - 150,000
Technical Product Manager, Pedagogy & AI Quality
Technical Product Manager, Pedagogy & AI Quality

Workshop Hiring • United States

Hybrid
USD 90,000 - 120,000
Technical Product Manager, Pedagogy & AI Quality
Technical Product Manager, Pedagogy & AI Quality

Workshop Venture Partners • Boston (MA)

Hybrid
USD 130,000 - 150,000
Product Manager - AI Content Gen & Quality Systems
Product Manager - AI Content Gen & Quality Systems

We Love AI Jobs • San Francisco (CA)

Hybrid
USD 191,000 - 315,000
Product Manager: AI-Powered Content Generation for Learners
Product Manager: AI-Powered Content Generation for Learners

Candidate • San Francisco (CA)

Hybrid
USD 140,000 - 190,000
Product Manager: AI Content at Scale
Product Manager: AI Content at Scale

Speak • San Francisco (CA)

On-site
USD 150,000 - 210,000
Remote Senior Product Manager, AI Education Initiatives
Remote Senior Product Manager, AI Education Initiatives

Weld North Education (now Imagine Learning) • United States

Remote
USD 120,000 - 170,000
Health, dental, vision plans
401k with company match
Paid holidays
+1