Quality Systems Lead - AI Data QA & Metrics (London)

present of AI; Greater London; Hybrid; GBP 75,000 - 110,000; Full time

Job summary

Encord in London seeks a Senior Operations professional to own the quality standard for human-labeled data. You will oversee both automated evaluation systems and a distributed audit team, writing rubrics and setting processes that scale with remote work.

You should be hands-on in Python and SQL, comfortable with sampling and agreement statistics, and able to defend standards under commercial pressure with clear evidence.

Qualifications

• Hands-on experience with Python and SQL.
• Ability to write clear rubrics for a remote team to follow.
• Experience with sampling and agreement statistics under commercial pressure.

Responsibilities

• Own the quality standard for human-labeled data, spanning automated evaluation and a distributed audit team.
• Oversee model-based evaluation and maintain rigorous quality controls under business constraints.
• Provide evidence-backed justification for standards and maintain traceability of decisions.

Skills

Python

SQL

Sampling

Agreement statistics

Job description

Encord in London seeks a Senior Operations professional to own the quality standard for human-labeled data. You will oversee both automated evaluation systems and a distributed audit team, writing rubrics and setting processes that scale with remote work.

You should be hands-on in Python and SQL, comfortable with sampling and agreement statistics, and able to defend standards under commercial pressure with clear evidence.