AI Data Labeling & Quality Analyst

Welo Global

Boston (MA)

On-site

USD 39,000 - 55,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Welo Data is seeking a Data Labeling Associate to join onsite in the United States. You will evaluate AI outputs, provide structured feedback, and help improve model behavior in real-world scenarios. The role emphasizes data quality, evaluation, and human judgment, requiring curiosity about AI and strong writing skills.

Open to candidates located in major cities; 40-hour full-time schedule with 100% onsite work. No remote option.

Qualifications

  • Native-level Portuguese (Brazil) proficiency and a university degree (Bachelor’s or higher).
  • B2 or superior level of English.
  • 1–2 years of professional writing experience with strong, structured writing skills.
  • Ability to apply complex writing rules and guidelines consistently.
  • Strong understanding of safety considerations in GenAI data delivery, with 2+ years of relevant experience.
  • Strong critical thinking and attention to detail.
  • Ability to make sound judgment calls in ambiguous situations.
  • Naturally curious about AI, technology, and how systems behave.

Responsibilities

  • Evaluate AI model outputs and provide structured, high-quality feedback.
  • Perform audit-based reviews of data and model behavior — identifying patterns, edge cases, and failure modes.
  • Apply guidelines thoughtfully — and flag when they don’t reflect real-world scenarios.
  • Contribute to improving evaluation frameworks, not just executing them.
  • Identify trends in model performance and communicate insights clearly.
  • Participate in team discussions, calibrations, and stakeholder syncs.
  • Partner with leads and cross-functional teams to refine quality standards.
  • Document findings in a clear, concise, and actionable way.

Skills

Portuguese (Brazil) proficiency
English proficiency (B2+)
Writing experience
Rules & guidelines
GenAI safety knowledge
Critical thinking
Judgment in ambiguity
Curiosity about AI

Education

Bachelor’s degree

Job description

Welo Data is seeking a Data Labeling Associate to join onsite in the United States. You will evaluate AI outputs, provide structured feedback, and help improve model behavior in real-world scenarios. The role emphasizes data quality, evaluation, and human judgment, requiring curiosity about AI and strong writing skills.

Open to candidates located in major cities; 40-hour full-time schedule with 100% onsite work. No remote option.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Data Labeling & Quality Analyst (Onsite)
AI Data Labeling & Quality Analyst (Onsite)

Welo Global • Boston (MA)

On-site
USD 39,000 - 55,000
Onsite AI Data Evaluator & Labeling Associate
Onsite AI Data Evaluator & Labeling Associate

Welo Data • California

On-site
USD 39,000 - 55,000
Paid Vacation
Health Insurance
401(k) Plan
+2
Onsite AI Data Labeling Associate — 1-Year Contract
Onsite AI Data Labeling Associate — 1-Year Contract

Welo Global • United States

On-site
USD 39,000 - 55,000
Onsite AI Data Labeling Specialist
Onsite AI Data Labeling Specialist

Welocalize, Inc. • United States

Remote
USD 40,000 - 54,000
AI Data Labeling & Quality Evaluator (Onsite)
AI Data Labeling & Quality Evaluator (Onsite)

Welo Global • Boston (MA)

On-site
USD 39,000 - 55,000
AI Data Quality & Evaluation Specialist (Onsite)
AI Data Quality & Evaluation Specialist (Onsite)

University of Delaware • New York (NY)

On-site
USD 61,200 - 74,800
Paid Vacation: 6 days
Medical, Dental, and Vision Insurance
401(k) Retirement Plan
+2
Turkish Data Labeling & AI Quality Associate (Onsite)
Turkish Data Labeling & AI Quality Associate (Onsite)

Welo Global • Boston (MA)

On-site
USD 39,000 - 55,000
AI Data Labeling Specialist (Onsite)
AI Data Labeling Specialist (Onsite)

Welo Global • United States

On-site
USD 40,000 - 54,000
AI Data Quality Analyst — French Labeling (Onsite)
AI Data Quality Analyst — French Labeling (Onsite)

Welo Global • Boston (MA)

On-site
USD 44,000 - 50,000
AI Data Labeling & Quality Evaluator
AI Data Labeling & Quality Evaluator

Welo Data • California

On-site
USD 39,000 - 55,000
Paid Vacation
Paid Holidays
Paid Sick Leave
+7