DET Proctoring Quality Lead

Duolingo; Greater London; On-site; GBP 91,000 - 123,000; Full time

Benefits offered by this job

Equity compensation

Job summary

United States Digital Space LLC is hiring a Proctor Quality and Learning Manager (L3) in Scaling Operations to own the end-to-end quality standard and learning system for the global proctor network. You will define what correct looks like, run calibration and adjudication cycles, and build a continuous training program.

You will collaborate with Psychometrics, Security, Operations, Product, and Engineering to ensure accuracy before and after deployment.

Qualifications

• 5+ years in assessment development, scoring/rater quality, certification, or related field.
• Adult-learning program experience including onboarding, certification, ongoing training, remediation, and effectiveness measurement.
• Exceptional attention to detail and ability to make clear, defensible decisions.

Responsibilities

• Own the DET proctoring quality standard with rubrics, rules, examples, and guidance.
• Lead calibration and adjudication across recurring certification cycles and disputes.
• Build and run a ongoing learning program with a training calendar and monthly interventions.
• Measure training impact using calibration results, audits, and performance trends.
• Guide Training Specialists and adjudicators, setting expectations and reviewing outputs.
• Maintain runbooks and sources of truth for calibration, adjudication, and training.
• Evolve quality standards in response to new threats and workflow changes with cross-functional teams.
• Represent proctoring practices in product experiments and workflow decisions.
• Define benchmarks for AI-assisted workflows and validate AI-enabled processes.

Skills

Assessment development

Quality assurance

Adult learning

Analytical fluency

Written communication

Cross-functional leadership

Job description

United States Digital Space LLC is hiring a Proctor Quality and Learning Manager (L3) in Scaling Operations to own the end-to-end quality standard and learning system for the global proctor network. You will define what correct looks like, run calibration and adjudication cycles, and build a continuous training program.

You will collaborate with Psychometrics, Security, Operations, Product, and Engineering to ensure accuracy before and after deployment.