AI Data Quality & Model Evaluator

Welocalize, Inc.; Burlingame (CA); On-site; USD 39,000 - 55,000; Full time

Benefits offered by this job

Paid Vacation: 6 days

Paid Holidays: 2 days

Paid Sick Leave

Medical, Dental, Vision Insurance

Health Savings Account

401(k) Retirement Plan

Employee Assistance Program

Free Gourmet Food

Free snacks & beverages

Commuter Benefits

Job summary

Welo Data is seeking a Data Labeling Associate to work onsite in the United States. You will evaluate AI outputs, identify gaps, and help improve model behavior in real-world contexts. A university degree and 1–2 years of writing experience are favored, with strong English skills and attention to detail.

This is a 1-year contract, full-time (40 hours per week), with on-site work only. The role emphasizes data quality, strict guidelines, and collaboration with cross-functional teams to drive

Qualifications

• Bachelor’s degree and native-level English required.
• 1–2 years of professional writing experience with structured writing.
• 2+ years of experience in GenAI data safety considerations.
• Strong critical thinking and attention to detail.

Responsibilities

• Evaluate AI model outputs and provide structured, high-quality feedback.
• Perform audit-based reviews of data and model behavior, identifying patterns and edge cases.
• Apply guidelines thoughtfully and flag when they don’t reflect real-world scenarios.
• Contribute to improving evaluation frameworks, not just executing them.
• Identify trends in model performance and communicate insights clearly.
• Participate in team discussions, calibrations, and stakeholder syncs.
• Partner with leads and cross-functional teams to refine quality standards.
• Document findings in a clear, concise, and actionable way.

Skills

Native English

Strong writing

Attention to detail

Critical thinking

Team collaboration

GenAI safety

Education

Bachelor's degree

Job description

Welo Data is seeking a Data Labeling Associate to work onsite in the United States. You will evaluate AI outputs, identify gaps, and help improve model behavior in real-world contexts. A university degree and 1–2 years of writing experience are favored, with strong English skills and attention to detail.

This is a 1-year contract, full-time (40 hours per week), with on-site work only. The role emphasizes data quality, strict guidelines, and collaboration with cross-functional teams to drive