AI Data Quality Lead & Audit Architect

Encord; London (KY); On-site; USD 119,000 - 158,000; Full time

Benefits offered by this job

Competitive salary

London office culture

25 days annual leave

Learning & development budget

Travel for UK & Europe

Company lunches

Team offsites

Job summary

Encord is seeking a Quality Systems Lead to own how we measure the quality of the human data we deliver to frontier AI labs and enterprises. You will build automated evaluation, manage a dedicated audit team in India, and define the standard across data types.

You’ll drive Python/SQL powered analysis, design sampling and agreement metrics, and bring quality measurement into Encord platform in collaboration with Product and Engineering.

Qualifications

• 4+ years owning technical and operational outcomes in a data/AI environment with measurable quality.
• Hands-on Python and SQL; build analysis and tooling rather than specify for others.
• Experience applying models and sampling design to quality/evaluation problems.
• Experience hiring, training and managing a distributed team (audit/review/QA).
• Bonus: STEM degree or background in data science or research engineering.

Responsibilities

• Build automated dataset quality evaluation and root-cause detection at scale.
• Hire, train, calibrate and manage an audit team based in India.
• Turn audit output into labeled ground truth to train the automated layer.
• Own the quality standard for every data type delivered, with rubrics and acceptance criteria.
• Build scoring systems for annotator/reviewer performance and operational decisions.
• Set pass thresholds for certification gates and monitor quality KPIs.
• Report quality metrics to leadership and customers.
• Collaborate with Product and Engineering to embed quality measurement in the platform.

Skills

Python

SQL

Statistical analysis

Quality assurance

Auditing

Education

Bachelor's in STEM

Tools

Pandas

Airflow

Job description

Encord is seeking a Quality Systems Lead to own how we measure the quality of the human data we deliver to frontier AI labs and enterprises. You will build automated evaluation, manage a dedicated audit team in India, and define the standard across data types.

You’ll drive Python/SQL powered analysis, design sampling and agreement metrics, and bring quality measurement into Encord platform in collaboration with Product and Engineering.