Head of Data Quality for AI Evaluation

CLERA

United States

On-site

USD 130,000 - 225,000

Full time

10 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Clera Labs, Inc. seeks a data quality lead to shape how training data for reinforcement learning and model evaluation is assessed and improved, helping research teams create more reliable and useful AI agents.

You will guide data quality strategy, mentor researchers and engineers, build production validation pipelines, dashboards, and feedback loops, and turn research insights into scalable review workflows in an on‑site, fast‑growing startup setting in the United States.

Qualifications

  • At least 5 years of research or engineering experience in AI/ML data evaluation or data quality systems.
  • Experience leading technical projects or teams through ambiguity from problem definition to iteration.
  • Strong proficiency in Python, Docker, and Linux.
  • Experience designing metrics, experiments, and quality processes for production data systems.
  • Ability to translate research findings into scalable review or generation workflows.

Responsibilities

  • Lead development of systems that evaluate tasks across reinforcement learning environments, synthetic data, benchmarks, and domain-specific workflows.
  • Set data quality strategy, establish standards, and design experiments to assess agent outputs.
  • Develop scalable methods for validating synthetic data, including failure analysis, task mutation checks, and trajectory audits.
  • Work with research engineers, domain experts, and data vendors to diagnose quality issues and improve data generation.
  • Turn research insights into production tools, dashboards, validation pipelines, and feedback loops.
  • Mentor research engineers and promote technical rigor, clear communication, and strong execution.

Skills

Python
Docker
Linux
Team leadership
Communication
AI data evaluation

Job description

Clera Labs, Inc. seeks a data quality lead to shape how training data for reinforcement learning and model evaluation is assessed and improved, helping research teams create more reliable and useful AI agents.

You will guide data quality strategy, mentor researchers and engineers, build production validation pipelines, dashboards, and feedback loops, and turn research insights into scalable review workflows in an on‑site, fast‑growing startup setting in the United States.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Research Engineer, Data Quality
Lead Research Engineer, Data Quality

CLERA • United States

On-site
USD 130,000 - 225,000
AI Evaluation Programs Lead (Remote-friendly)
AI Evaluation Programs Lead (Remote-friendly)

CLERA • San Francisco (CA)

On-site
USD 130,000 - 225,000
Visa sponsorship
Relocation assistance
Competitive salary
Senior RL Environment Architect for AI Evaluation (Remote)
Senior RL Environment Architect for AI Evaluation (Remote)

Clera • United States

Remote
USD 110,000 - 276,000
Remote Data Operations Lead - AI Datasets & QA
Remote Data Operations Lead - AI Datasets & QA

Clera • United States

Remote
USD 62,000 - 124,000
Remote AI Data Operations Specialist
Remote AI Data Operations Specialist

Clera • United States

Remote
USD 28,000 - 55,000
Senior AI Data Quality Lead
Senior AI Data Quality Lead

Turing • United States

Remote
USD 120,000 - 160,000
Remote AI Evaluation & Testing Specialist
Remote AI Evaluation & Testing Specialist

Clera • United States

Remote
USD 41,000 - 83,000
Remote work
Remote QA Engineer - AI Data Quality & Evaluation
Remote QA Engineer - AI Data Quality & Evaluation

YO AI Labs • New York (NY)

Remote
USD 34,000 - 69,000
Founding Engineer: AI Evaluation Environments & Data
Founding Engineer: AI Evaluation Environments & Data

CLERA • San Francisco (CA)

On-site
USD 200,000 - 300,000
Founding equity
Visa sponsorship
Head of AI Data Quality & Audits - Remote
Head of AI Data Quality & Audits - Remote

Executive Staff Recruiters / ESR Healthcare • United States

Remote
USD 90,000 - 130,000