Onsite Data Quality Analyst — AI/ML Calibration

Welo Data

California

On-site

USD 44,000 - 61,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Paid vacation
Health insurance
401k plan
HSA
Free meals

Job summary

Welo Data is seeking a Data Quality Analyst to bridge DLAs and Team Leads, ensuring high-quality outputs in a fully onsite role across multiple US locations. The position emphasizes auditing, training, and strict adherence to guidelines in fast-moving AI data workflows.

Ideal candidates have 2–4 years in data annotation or QA, strong attention to detail, and university degrees. Onsite relocation to Bay Area, Seattle, NYC, or client sites may be required.

Qualifications

  • 2–4 years of experience in data annotation, content quality, QA, or related fields.
  • Strong ability to interpret and apply complex guidelines with consistency.
  • Excellent attention to detail with a high bar for quality.
  • Ability to stay consistent while working with evolving guidelines and priorities.
  • Experience in AI/ML data workflows or human-in-the-loop evaluation environments.
  • Prior experience auditing or reviewing the work of others.
  • Familiarity with safety, compliance, or policy-driven content evaluation.

Responsibilities

  • Support quality and execution across DLA teams, ensuring work meets defined standards at scale.
  • Audit DLA outputs and provide structured, actionable feedback to improve accuracy and consistency.
  • Act as the first line of support for DLAs — answering questions and helping interpret guidelines.
  • Help DLAs navigate ambiguity and apply evolving instructions effectively.
  • Support onboarding and training of new DLAs through hands-on guidance and coaching.
  • Monitor workflows, queues, and blockers — escalating risks and gaps to Team Leads.
  • Identify patterns, recurring issues, and edge cases in both human and model outputs.
  • Participate in calibrations, team discussions, and stakeholder syncs.
  • Contribute to improving guidelines, processes, and overall team performance.
  • Document findings and feedback in a clear, concise, and actionable way.

Skills

Italian language
English proficiency

Education

Bachelor’s degree or higher

Job description

Welo Data is seeking a Data Quality Analyst to bridge DLAs and Team Leads, ensuring high-quality outputs in a fully onsite role across multiple US locations. The position emphasizes auditing, training, and strict adherence to guidelines in fast-moving AI data workflows.

Ideal candidates have 2–4 years in data annotation or QA, strong attention to detail, and university degrees. Onsite relocation to Bay Area, Seattle, NYC, or client sites may be required.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Onsite Data Quality Analyst: AI QA & Training
Onsite Data Quality Analyst: AI QA & Training

Welo Data • California

On-site
USD 43,000 - 62,000
Paid Vacation 6 days
Paid Holidays 2 days
Medical, Dental, Vision Insurance
+4
Data Quality Analyst: AI Workflows & Training Lead
Data Quality Analyst: AI Workflows & Training Lead

Energy Jobline ZR • Burlingame (CA)

On-site
USD 43,000 - 62,000
Paid Vacation
Paid Holidays
Sick Leave
+8
Data Quality Analyst for Human-in-the-Loop AI (Onsite)
Data Quality Analyst for Human-in-the-Loop AI (Onsite)

Welo Global • Austin (TX)

On-site
USD 43,000 - 62,000
Data Quality Analyst — Spanish Speaker for AI QA
Data Quality Analyst — Spanish Speaker for AI QA

Welo Data • San Francisco (CA)

On-site
USD 43,000 - 62,000
Paid Vacation
Holidays
Sick Leave
+9
Data Quality Analyst – Portuguese (PT) for AI QA
Data Quality Analyst – Portuguese (PT) for AI QA

Welo Data • San Francisco (CA)

On-site
USD 43,000 - 62,000
Paid Vacation: 6 days
Paid Company Holidays: 2 days
Paid Sick Leave
+6
Data Quality Analyst: Onsite QA & Training
Data Quality Analyst: Onsite QA & Training

Welo Global • Sunnyvale (CA)

On-site
USD 44,083 - 52,348
Paid Sick Time & Paid Holiday (combined): 15 days
Free Gourmet Food
401(k) Retirement Plan
+1
Onsite Data Quality Analyst for AI QA
Onsite Data Quality Analyst for AI QA

Welo Global • Sunnyvale (CA)

On-site
USD 41,328 - 55,104
Paid Sick Time & Paid Holiday (combined): 15 days
Medical, Dental, and Vision Insurance
Free Gourmet Food
+2
Onsite Data Quality Analyst & Training Coach
Onsite Data Quality Analyst & Training Coach

Welo Data • California

On-site
USD 32,000 - 52,000
Paid Vacation
Paid Holidays
Medical Insurance
+1
AI Quality Auditor — Data Integrity Analyst (Onsite)
AI Quality Auditor — Data Integrity Analyst (Onsite)

Welo Data • Boston (MA)

On-site
USD 112,000 - 137,000
Medical Insurance
Dental & Vision Insurance
401(k) Retirement Plan
+1
Onsite Data Quality Analyst - AI Labeling QA
Onsite Data Quality Analyst - AI Labeling QA

Welo Data • Austin (TX)

On-site
USD 108,000 - 132,000
Paid Vacation: 6 days
Paid Company Holidays: 2 days
Medical, Dental, Vision Insurance