Expert Talent Pool, Data Operations (Expert, 5+ Years)

Clera

United States

Remote

USD 62,000 - 124,000

Full time

44 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Clera is seeking a remote data operations expert to lead data sourcing, curation and quality across AI training datasets. You will set specifications, acceptance criteria, and track yield and quality at scale, while coaching annotators and coordinating calibration rounds with teams.

Qualifications include 5+ years in data operations or QA-led roles, experience with labeling guidelines, and proficiency in annotation tools and SQL.

Qualifications

  • Creative data ops expertise required; QA and data quality focus.
  • Experience leading QA, guideline ownership, or data projects.
  • Experience running data sourcing programs with specs and quality metrics.
  • Proficiency with annotation tools and SQL/spreadsheets.

Responsibilities

  • Lead data sourcing programs: specs, acceptance criteria, quality tracking.
  • Manage media capture and document contribution; curate datasets.
  • Design synthetic data generation pipelines and validation checks.
  • Review annotations; adjudicate disagreements; calibration rounds.
  • Write & update labeling guidelines; identify gaps and edge cases.
  • Coach annotators; report agreement/error rates to teams.

Skills

Data operations
Annotation QA
Data quality
Dataset management
QA lead experience

Tools

Label Studio
Labelbox
CVAT
Scale
Remotasks
Appen
SQL
Spreadsheets

Job description

About the Role

Lead data operations for teams developing advanced AI models, owning the quality of datasets used for training and evaluation. This flexible expert network matches experienced data operations professionals with project work based on their backgrounds.

What You'll Do
  • Lead data sourcing and collection programs by writing specifications, setting acceptance criteria, and tracking yield and quality.

  • Manage media capture and document contribution at scale, then curate and validate the resulting datasets.

  • Design synthetic data generation pipelines and validation checks to assess data quality.

  • Review annotations, adjudicate disagreements, and run calibration and audit rounds with annotator teams.

  • Write and maintain labelling guidelines, identifying gaps and incorporating new edge cases.

  • Coach annotators and reviewers, and report agreement rates, error rates, and other quality metrics to project teams.

What We're Looking For
  • At least 5 years of experience in data operations, annotation QA, data quality, dataset management, or a relevant domain with hands-on human-data work.

  • Experience leading or reviewing others' work as a QA lead, guideline owner, adjudicator, team lead, or data project manager.

  • Experience running data sourcing or collection programs, including setting specifications, acceptance criteria, and quality measures.

  • Proficiency with annotation tools such as Label Studio, Labelbox, CVAT, Scale, Remotasks, or Appen, and spreadsheets or SQL for quality analysis.

  • Experience owning labelling guidelines and conducting annotation reviews, calibration, or audits while measuring agreement or error rates.

  • Clear written communication for explaining data quality issues and solutions. Experience with synthetic data validation, large-scale media capture, document contribution, dataset curation, or coaching annotators is also relevant.

Compensation & Benefits

Compensation is $45 to $90 per hour, depending on the project, field, and level. Payment is based on hours worked.

Location

Fully remote. Projects range from one week to several months.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Expert Talent Pool, Data Operations (Expert, 5+ Years)
Expert Talent Pool, Data Operations (Expert, 5+ Years)

Expert Talent Pool • United States

Remote
USD 62,000 - 124,000
Fully remote
Project-based duration
Data Operations Associate, Expert Talent Pool
Data Operations Associate, Expert Talent Pool

Clera • United States

Remote
USD 28,000 - 55,000
Data Operations Associate, Expert Talent Pool
Data Operations Associate, Expert Talent Pool

Clera • United States

Remote
USD 28,000 - 55,000
Hourly pay
Expert Talent Pool, Annotation Associate
Expert Talent Pool, Annotation Associate

Clera • United States

Remote
USD 21,000 - 48,000
Expert Annotation Specialist
Expert Annotation Specialist

Clera • United States

Remote
USD 55,000 - 103,000
Fully remote
Remote Data Operations Lead — QA, Dataset Curation & Synthetic Data
Remote Data Operations Lead — QA, Dataset Curation & Synthetic Data

Expert Talent Pool • United States

Remote
USD 62,000 - 124,000
Fully remote
Project-based duration
General AfterQuery Expert (Data Annotator)
General AfterQuery Expert (Data Annotator)

AfterQuery • United States

Remote
USD 60,000 - 90,000
Remote Data Operations Lead - AI Datasets & QA
Remote Data Operations Lead - AI Datasets & QA

Clera • United States

Remote
USD 62,000 - 124,000
Data Scientist Team Lead
Data Scientist Team Lead

SME.careers • United States

Remote
USD 55,000 - 110,000
Data Scientist Team Lead
Data Scientist Team Lead

SuperAnnotate AI, Inc. • United States

Remote
USD 187,000 - 270,000