Onsite AI Quality Evaluator & Data Labeling Specialist

Welo Global; Sunnyvale (CA); On-site; USD 61,200 - 74,800; Full time

Benefits offered by this job

Paid Vacation

Paid Company Holidays

Medical Insurance

Health Savings Account

401(k)

Employee Assistance Program

Free Gourmet Food

Commuter Benefits

Job summary

Welo Data is seeking a Data Labeling Associate to evaluate AI outputs and provide high-quality feedback. You will audit data and model behavior, identify gaps, and help improve evaluation frameworks in a collaborative, fast-moving environment.

The role requires native-level English, 1–2 years writing experience, and the ability to apply guidelines consistently. It is a 100% onsite position with a 1-year contract and 40 hours per week in the United States.

Qualifications

• Native-level English speaker with strong writing skills.
• 1–2 years of professional writing or equivalent experience.
• Ability to apply complex writing rules and guidelines consistently.
• Understanding of safety considerations in GenAI data delivery, with relevant experience.

Responsibilities

• Evaluate AI model outputs and provide structured feedback.
• Perform audit-based reviews of data and model behavior to identify patterns and edge cases.
• Apply guidelines thoughtfully and flag if they don’t reflect real-world scenarios.
• Contribute to improving evaluation frameworks beyond execution of them.
• Identify trends in model performance and communicate insights clearly.
• Participate in team discussions, calibrations, and stakeholder syncs.
• Partner with leads and cross-functional teams to refine quality standards.
• Document findings in a clear, concise, actionable way.

Skills

English proficiency

Attention to detail

Education

Bachelor’s degree or higher

Job description

Welo Data is seeking a Data Labeling Associate to evaluate AI outputs and provide high-quality feedback. You will audit data and model behavior, identify gaps, and help improve evaluation frameworks in a collaborative, fast-moving environment.

The role requires native-level English, 1–2 years writing experience, and the ability to apply guidelines consistently. It is a 100% onsite position with a 1-year contract and 40 hours per week in the United States.