AI Annotation Lead — Quality & Prompt Architect

BrightClaim

Greater London

On-site

GBP 55,000 - 90,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Genpact is seeking an experienced QA/Annotation lead to orchestrate high‑quality AI annotation across multiple use cases from our UK office. You will design prompts, schemas, and evaluation rubrics, while ensuring auditability and bias mitigation. You’ll collaborate with data scientists and product teams, driving delivery improvements and mentoring junior annotators.

The role emphasizes governance, responsible AI, and scalable QA practices in a fast-moving, innovation-driven environment.

Qualifications

Bachelor-level degree in a relevant engineering/IT field.
Advanced English proficiency (C1).
Experience in software quality assurance and testing across AI/ML pipelines.
Ability to lead QA automation initiatives and mentor teammates.

Responsibilities

Identify and manage project deliverables.
Lead the design, optimization, and standardization of annotation processes across AI use cases.
Collaborate with AI team to define annotation schemas, taxonomies, and evaluation rubrics.
Review complex or high-risk AI outputs and provide quality judgments.
Ensure consistency, accuracy, and auditability of annotation results.
Define reusable prompt frameworks and best practices aligned with governance objectives.
Evaluate prompt performance at scale and guide improvements with data-driven insights.
Establish quality benchmarks, calibration processes, and escalation protocols.
Identify bias and systemic risks in AI outputs and recommend mitigations.
Support AI governance and responsible AI initiatives.
Participate in calibration sessions to align annotation standards across the team.
Work with data scientists, content reviewers, and product teams.
Foster continuous learning and delivery improvement; mentor junior annotators.