AI Evaluation & Data Quality Associate

welo-data; United States; On-site; USD 39,950 - 53,726; Full time

Benefits offered by this job

Medical, Dental, Vision Insurance

401(k) Retirement Plan

Paid Vacation

Job summary

Welo Data is seeking a Data Labeling Associate to join our team onsite in Washington state. You’ll work directly with cutting-edge AI systems, evaluating outputs, flagging gaps, and providing high-quality feedback to improve real-world performance.

This 1-year, full-time role requires a university degree, native-level English, and 1–2 years of writing experience. The position is 40 hours per week, on-site only, with a $34/hour pay rate and no visa sponsorship.

Qualifications

• Native-level Canadian English proficiency and a university degree.
• 1–2 years of professional writing experience with strong, structured writing skills.
• Ability to apply complex writing rules and guidelines consistently.
• Strong understanding of safety considerations in GenAI data delivery, with 2+ years of relevant experience.

Responsibilities

• Evaluate AI model outputs and provide structured, high-quality feedback.
• Perform audit-based reviews of data and model behavior — identifying patterns, edge cases, and failure modes.
• Apply guidelines thoughtfully — and flag when they don’t reflect real-world scenarios.
• Contribute to improving evaluation frameworks, not just executing them.
• Identify trends in model performance and communicate insights clearly.
• Participate in team discussions, calibrations, and stakeholder syncs.
• Partner with leads and cross-functional teams to refine quality standards.
• Document findings in a clear, concise, and actionable way.

Skills

English proficiency

Writing experience

Critical thinking

Attention to detail

Communication skills

Ability to work independently

Curiosity about AI

Education

Bachelor’s degree

Tools

QA tools

Job description

Welo Data is seeking a Data Labeling Associate to join our team onsite in Washington state. You’ll work directly with cutting-edge AI systems, evaluating outputs, flagging gaps, and providing high-quality feedback to improve real-world performance.

This 1-year, full-time role requires a university degree, native-level English, and 1–2 years of writing experience. The position is 40 hours per week, on-site only, with a $34/hour pay rate and no visa sponsorship.