Founding Human Data Quality Engineer (Remote)

Prolific; Greater London; On-site; GBP 85,000 - 110,000; Full time

Benefits offered by this job

Remote-friendly

Equity included

Benefits

Job summary

Prolific is hiring a Human Data Quality Engineer on the founding AI Data Services team. You will design quality frameworks, partner with frontier labs and clients, and embed quality into every lifecycle stage from study design to delivery.

You’ll build scalable quality systems using Python and SQL, collaborate with product and engineering, and drive improvements across data programmes in a high-visibility role.

Qualifications

• 5+ years of experience in building quality, evaluation or annotation systems within AI, machine learning, LLMs or human data environments.
• Strong Python and SQL skills, with a passion for using data to solve quality problems.
• Solid understanding of machine learning pipelines and how human data impacts model performance.

Responsibilities

• Design the quality frameworks that underpin complex human data programmes.
• Work with clients as a strategic thought partner, challenging annotation schemas and data requirements.
• Advise on project design and how the choice of schema can impact data quality.
• Build quality upstream across the operational workflow, from recruitment, screening, and training through to guidelines and calibration sessions.
• Build scalable quality systems, measurement frameworks and automated checks using Python and SQL.
• Partner with product and engineering to build the quality infrastructure that delivers high‑quality human data at scale.
• Investigate data quality and integrity issues, identifying root causes and turning insights into scalable improvements.
• Architect and build dashboards, monitoring and reporting that provide visibility into quality and performance.
• Raise the quality capability across the company, upskilling operations and mentoring junior analysts.
• Help define how Prolific approaches quality across new AI domains, shaping best practice as the team grows.

Skills

Python

SQL

Quality systems design

Stakeholder management

Data analysis

ML pipelines understanding

Job description

Prolific is hiring a Human Data Quality Engineer on the founding AI Data Services team. You will design quality frameworks, partner with frontier labs and clients, and embed quality into every lifecycle stage from study design to delivery.

You’ll build scalable quality systems using Python and SQL, collaborate with product and engineering, and drive improvements across data programmes in a high-visibility role.