Founding Human Data Quality Engineer — Remote

Prolific; United Kingdom; On-site; GBP 120,000 - 180,000; Full time

Benefits offered by this job

Equity

Remote work

Bonus potential

Job summary

Prolific is building the AI data infrastructure for frontier models. As a founding member of the AI Data Services team, you’ll help design quality systems that scale and influence high-stakes AI research.

This is not a traditional QA role; you’ll define what good looks where no definition exists yet. You’ll work directly with clients and frontier labs, translating model needs into robust evaluation strategies and embedding quality into every lifecycle stage.

Qualifications

• 5+ years building quality, evaluation or annotation systems within AI, ML or human data environments.
• Strong Python and SQL skills with a passion for using data to solve quality problems.
• Solid understanding of machine learning pipelines and how human data impacts model performance.
• Strong analytical and statistical thinking; experience designing scalable quality frameworks.
• The confidence to interact with frontier labs and act as a partner to stakeholders.
• Ability to translate data analysis and quality methodology into product/engineering requirements.
• Clear ability to explain data findings to non-technical stakeholders.
• A proactive, builder’s mindset—creating new systems and navigating ambiguity.

Responsibilities

• Design the quality frameworks underpinning complex human data programmes, from evaluation rubrics to launch readiness.
• Advise clients as a strategic partner, challenging schemas and data requirements.
• Guide project design and how schema choice impacts data quality.
• Build upstream quality across recruitment, screening, training, guidelines and calibration sessions.
• Develop scalable quality systems, measurement frameworks and automated checks using Python and SQL.
• Partner with product and engineering to implement quality infrastructure at scale.
• Investigate data quality issues, identify root causes and drive scalable improvements.
• Architect dashboards, monitoring and reports for visibility into quality and performance.
• Raise quality capability across the company and mentor junior analysts.
• Help define Prolific’s quality approach across new AI domains.

Skills

Python

SQL

Data quality

Stakeholder mgmt

Analytical thinking

ML pipelines

Problem solving

Job description

Prolific is building the AI data infrastructure for frontier models. As a founding member of the AI Data Services team, you’ll help design quality systems that scale and influence high-stakes AI research.

This is not a traditional QA role; you’ll define what good looks where no definition exists yet. You’ll work directly with clients and frontier labs, translating model needs into robust evaluation strategies and embedding quality into every lifecycle stage.