Proctor Quality & Learning Lead

Duolingo; Greater London; On-site; GBP 91,000 - 123,000; Full time

Job summary

Duolingo is hiring a Proctor Quality and Learning Manager to own the end-to-end quality standard for DET proctoring within Scaling Operations. You will develop training, calibration, and adjudication programs to ensure accurate decisions across evolving threats and workflows.

You will partner with Psychometrics, Security, Operations, Product, and Engineering to align human and AI-assisted processes, delivering measurable improvements in decision quality and auditable training materials.

Qualifications

• 5+ years in assessment development or quality assurance with calibration programs.
• Experience with adult-learning onboarding, certification, and training measurement.
• Detail-oriented with ability to justify decisions.
• Analytical fluency to interpret quality data and trends.
• Strong written and verbal communication for precise guidance.
• Cross-functional leadership without direct authority.
• Experience with quality standards and rubrics with audit trails.
• Familiarity with AI-assisted workflows quality considerations.

Responsibilities

• Own DET proctoring quality standards and guidelines.
• Lead calibration and adjudication cycles.
• Develop a forward-looking training calendar and monthly interventions.
• Measure training impact and adjust standards as needed.
• Guide Training Specialists and adjudicators on expectations.
• Maintain runbooks and auditable processes.
• Translate threats and workflow changes into training and quality controls.
• Bridge human and AI-assisted quality in product decisions.

Skills

Assessment development

Rater quality

Certification

Quality assurance

Onboarding training

Data interpretation

Clear communication

Cross-functional leadership

Quality standards design

AI-assisted workflows

Tools

Learning management systems (LMS)

Assessment platforms

Quality-audit tools

Operational analytics

Job description

Duolingo is hiring a Proctor Quality and Learning Manager to own the end-to-end quality standard for DET proctoring within Scaling Operations. You will develop training, calibration, and adjudication programs to ensure accurate decisions across evolving threats and workflows.

You will partner with Psychometrics, Security, Operations, Product, and Engineering to align human and AI-assisted processes, delivering measurable improvements in decision quality and auditable training materials.