Remote Data Quality Analyst for AI Evaluation

RemoteJobsOne

Detroit (MI)

Remote

USD 41,000 - 83,000

Full time

2 days ago
Be an early applicant
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

RemoteJobsOne is seeking a Data Analyst (AI Evaluation) contractor to help assess data quality for a customer project. You will review datasets, apply rubrics, and provide actionable feedback to improve AI training inputs. Strong attention to detail and crisp communication are essential for success.

No prior AI experience is required; domain knowledge in data review and a proven ability to follow complex instructions are valued. This is a fully remote US-based opportunity with contract status.

Qualifications

  • 3–5+ years in data review, quality, or analytical roles.
  • Proven ability to review and critique data against criteria.
  • Follow detailed written instructions and complex rubrics.
  • Comfort with ambiguity and justifiable decision making.
  • Strong attention to detail on high-volume tasks.
  • Excellent written and verbal communication for feedback.
  • Baseline Excel; SQL experience is a plus.

Responsibilities

  • Review datasets and task outputs for accuracy and completeness.
  • Identify and flag inconsistencies and errors.
  • Apply evaluation rubrics consistently across datasets.
  • Document rationale in ambiguous scenarios.
  • Escalate recurring data issues for analysis.
  • Provide clear written and verbal feedback with resolutions.
  • Maintain meticulous attention to detail on large volumes of data.

Skills

Data QA
Data validation
Rubric evaluation
Ambiguity tolerance
Attention to detail
Written communication
SQL querying
Data annotation

Tools

SQL
Excel basics

Job description

RemoteJobsOne is seeking a Data Analyst (AI Evaluation) contractor to help assess data quality for a customer project. You will review datasets, apply rubrics, and provide actionable feedback to improve AI training inputs. Strong attention to detail and crisp communication are essential for success.

No prior AI experience is required; domain knowledge in data review and a proven ability to follow complex instructions are valued. This is a fully remote US-based opportunity with contract status.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Data Analyst: AI Evaluation & Quality Review
Remote Data Analyst: AI Evaluation & Quality Review

Appsierra Group • United States

Remote
USD 58,000 - 115,000
Remote work
Contractor engagement
Remote Data Analyst for AI Evaluation
Remote Data Analyst for AI Evaluation

Remolity, Inc. • Northern (KY)

Hybrid
USD 60,000 - 90,000
Special Referral
Remote Data Quality & Privacy Analyst
Remote Data Quality & Privacy Analyst

YO AI Labs • Los Angeles (CA)

Remote
USD 55,000 - 83,000
Remote Data Quality Analyst for AI Training (Contract)
Remote Data Quality Analyst for AI Training (Contract)

YO AI Labs • Washington

Remote
USD 34,000 - 83,000
Remote Data Analyst - AI Training & Data QA (Contract)
Remote Data Analyst - AI Training & Data QA (Contract)

RemoteJobsOne • Los Angeles (CA)

Remote
USD 43,000 - 83,000
Contract Remote Data Quality & Privacy Analyst
Contract Remote Data Quality & Privacy Analyst

YO AI Labs • Town of Schroeppel (NY)

Remote
USD 41,000 - 83,000
Data Analyst (AI Evaluation)
Data Analyst (AI Evaluation)

Remolity, Inc. • Northern (KY)

Hybrid
USD 60,000 - 90,000
Special Referral
Remote Data Scientist - AI Evaluation & ML Quality
Remote Data Scientist - AI Evaluation & ML Quality

YO AI Labs • Maryland

Remote
USD 83,000 - 124,000
Remote Data Quality & Privacy Analyst (Contractor)
Remote Data Quality & Privacy Analyst (Contractor)

YO AI Labs • Atlanta (GA)

Remote
USD 50,000 - 70,000
Remote Data Quality & Privacy Analyst for AI Training
Remote Data Quality & Privacy Analyst for AI Training

24-MAG • United States

Remote
USD 41,000 - 83,000