AI Human-Data Architect & Evaluation Lead

LeoVegas Group; Tees Valley; On-site; GBP 70,000 - 90,000; Full time

Job summary

A leading online gaming company in the UK is seeking a Human Data Manager to own the end-to-end strategy for human data across AI training and evaluation. In this role, you will design human data tasks, oversee pipelines, and ensure high-quality data insights. The ideal candidate will have extensive experience in machine learning and data workflows, proficiency in collaborating with cross-functional teams, and a strong background in data quality management. This position offers a key opportunity to shape human data practices for product improvement.

Qualifications

• 6-10+ years working with ML/AI systems, including 3+ years owning human data workflows.
• Deep understanding of LLM training stacks and post-training methods.
• Proven track record working with annotation vendors or internal labeling teams at scale.

Responsibilities

• Own the end-to-end strategy and roadmap for human data.
• Design and iterate high-signal human data tasks in partnership with teams.
• Architect and oversee human data pipelines across vendors and internal teams.

Skills

Machine Learning/AI systems

Data quality strategies

Collaboration with stakeholders

Communication skills

Data pipelines architecture

Tools

Annotation tools

Internal platforms for RLHF

Job description

A leading online gaming company in the UK is seeking a Human Data Manager to own the end-to-end strategy for human data across AI training and evaluation. In this role, you will design human data tasks, oversee pipelines, and ensure high-quality data insights. The ideal candidate will have extensive experience in machine learning and data workflows, proficiency in collaborating with cross-functional teams, and a strong background in data quality management. This position offers a key opportunity to shape human data practices for product improvement.