Proctor Quality & Learning Leader

Duolingo

Pennsylvania

On-site

USD 143,000 - 193,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Duolingo is seeking a Proctor Quality and Learning Manager (L3) within DET Proctoring Operations to own end-to-end quality standards, calibration, and training. You will partner with Psychometrics, Security, Operations, Product, and Engineering to ensure accuracy in human and AI-assisted workflows throughout deployment.

The role emphasizes building a learning program, measuring impact, and guiding Training Specialists to maintain audit-ready processes and rubrics that ensure consistent decision

Qualifications

  • 5+ years in assessment development, scoring/rater quality, certification, quality assurance.

Responsibilities

  • Own the DET proctoring quality standard and define accurate decisions across edge cases.
  • Lead calibration and adjudication cycles, resolve disputed decisions, ensure consistency.
  • Build and run an ongoing learning program with a training calendar and monthly interventions.
  • Measure effectiveness using calibration results and performance trends.
  • Guide specialists and set expectations for Training Specialists and adjudicators.
  • Maintain runbooks and ensure processes are auditable.
  • Evolve quality with proctoring by updating standards with cross-functional partners.
  • Represent proctoring craft and assess AI-assisted workflows for changes.
  • Connect human and AI quality with benchmarks for AI-assisted workflows before deployment.

Skills

Assessment development

Job description

Duolingo is seeking a Proctor Quality and Learning Manager (L3) within DET Proctoring Operations to own end-to-end quality standards, calibration, and training. You will partner with Psychometrics, Security, Operations, Product, and Engineering to ensure accuracy in human and AI-assisted workflows throughout deployment.

The role emphasizes building a learning program, measuring impact, and guiding Training Specialists to maintain audit-ready processes and rubrics that ensure consistent decision

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Proctor Quality & Learning Lead (Global Calibration)
Proctor Quality & Learning Lead (Global Calibration)

Duolingo • Pittsburgh

On-site
USD 140,000 - 195,000
Proctor Quality and Learning Manager, Scaling Operations
Proctor Quality and Learning Manager, Scaling Operations

Duolingo • Pittsburgh

On-site
USD 140,000 - 195,000
Proctor Quality and Learning Manager, Scaling Operations
Proctor Quality and Learning Manager, Scaling Operations

Duolingo • Pennsylvania

On-site
USD 143,000 - 193,000
Senior PM: DET UX & AI Proctoring
Senior PM: DET UX & AI Proctoring

The Briefed • New York (NY)

On-site
USD 183,000 - 247,000
Competitive base salary and equity
Medical, dental, and vision insurance
Generous time-off & development budget
Language Assessment Scientist for High-Impact Tests
Language Assessment Scientist for High-Impact Tests

Duolingo • Pittsburgh

On-site
USD 111,000 - 150,000
Senior Product Manager: English Test & Global Growth
Senior Product Manager: English Test & Global Growth

EngineersOfAI • New York (NY)

On-site
USD 150,000 - 190,000
Senior Product Manager - DET User Experience & AI
Senior Product Manager - DET User Experience & AI

The Briefed • New York (NY)

On-site
USD 183,000 - 247,000
Competitive base salary and equity
Medical, dental, and vision insurance
Generous time-off & development budget
QA Specialist I — Equity & Learner-Focused Testing
QA Specialist I — Equity & Learner-Focused Testing

Duolingo • New York (NY)

On-site
USD 68,000 - 78,000
Senior Product Manager — Scale a Global English Test
Senior Product Manager — Scale a Global English Test

Duolingo • Pennsylvania

On-site
USD 183,000 - 247,000
Senior Product Manager, Global English Test
Senior Product Manager, Global English Test

EngineersOfAI • Pittsburgh

On-site
USD 120,000 - 150,000