Expert Rater & Coaching Lead for AI Quality

Welo Global; United States; On-site; USD 25,000 - 36,000; Full time

Job summary

Welo Data, part of Welocalize, is seeking an Expert Rater to support and coach raters, guide client test rounds, and ensure alignment with quality benchmarks. You will analyze datasets, craft communications, and collaborate with CEM and R&D to enhance rating accuracy for AI data projects.

This freelance role offers flexible scheduling, with potential extension based on performance and project needs, and starts July 27th in the United States.

Qualifications

• Active listening with empathy to understand speakers.
• Experience in data labeling, annotation, and evaluation methodologies.

Responsibilities

• Support Raters in skill development and best practices for accurate ratings.
• Ensure annotation selection and gold set creation adhere to templates.
• Analyze datasets to identify patterns and KPIs for data-driven decisions.
• Craft client communications, emails, questions, and feedback.
• Collaborate with research and development teams to enhance client data.
• Work with clients and CEM to conduct test rounds and understand quality benchmarks.
• Conduct independent evaluations to sustain and improve proficiency.

Skills

Active Listening

Effective Communication

Proactiveness

Cultural Adaptability

Psychological Safety

Research Skills

Rating Experience

Education

Social sciences background

Experience in quality roles

Tools

Google Workspace

Job description

Welo Data, part of Welocalize, is seeking an Expert Rater to support and coach raters, guide client test rounds, and ensure alignment with quality benchmarks. You will analyze datasets, craft communications, and collaborate with CEM and R&D to enhance rating accuracy for AI data projects.

This freelance role offers flexible scheduling, with potential extension based on performance and project needs, and starts July 27th in the United States.