Founding Human Data Quality Engineer

Prolific; United States; Remote; USD 140,000 - 190,000; Full time

Benefits offered by this job

Remote work

Competitive compensation

Equity

Job summary

Prolific is seeking a Human Data Quality Engineer (Founding Team) to architect end-to-end quality for AI data and evaluation. You’ll partner with frontier AI labs, define quality where none exists, and design scalable frameworks spanning study design, recruitment, and delivery.

You’ll build robust quality infrastructure with Python and SQL, translate client needs into concrete data requirements, and raise capability across the company as we expand into new AI domains.

Qualifications

• 5+ years building quality, evaluation or annotation systems within AI, ML, or human data environments.
• Strong Python and SQL skills with a data-driven approach to quality problems.
• Solid understanding of machine learning pipelines and data impact on model performance.
• Ability to interact with frontier labs and articulate data requirements to non-technical stakeholders.

Responsibilities

• Design quality frameworks for complex human data programmes, including evaluation rubrics and launch readiness.
• Advise on project design and how schema choices affect data quality.
• Build upstream quality across the lifecycle from recruitment to calibration sessions.
• Develop scalable quality systems, measurement frameworks, and automated checks using Python and SQL.
• Collaborate with product and engineering to deliver high-quality human data at scale.
• Investigate data quality issues, identify root causes, and implement scalable improvements.
• Architect dashboards and reporting to provide visibility into quality and performance.
• Raise quality capability across the company and mentor junior analysts.
• Shape Prolific’s approach to quality across new AI domains.

Skills

Python

SQL

Statistical thinking

Data quality frameworks

Stakeholder management

ML pipelines understanding

Job description

Prolific is seeking a Human Data Quality Engineer (Founding Team) to architect end-to-end quality for AI data and evaluation. You’ll partner with frontier AI labs, define quality where none exists, and design scalable frameworks spanning study design, recruitment, and delivery.

You’ll build robust quality infrastructure with Python and SQL, translate client needs into concrete data requirements, and raise capability across the company as we expand into new AI domains.