Expert Rater & Coaching Specialist (German)

Remote; San Francisco (CA); Remote; USD 22,000 - 32,000; Full time

Benefits offered by this job

Limitless Flexibility

Limitless Growth

Limitless Support

Job summary

Welo Data seeks an Expert Rater to support and coach fellow Raters, drive quality in AI data for client projects, and mentor teams on rating accuracy. You will guide test rounds, explain templates, and help maintain high standards across diverse datasets.

The role emphasizes cross-functional communication, collaboration with clients and research teams, and ongoing evaluation of performance. Remote, freelance engagement with potential for full-time extension based on outcomes.

Qualifications

• 1+ years of rating experience required.
• Understanding of data labeling, annotation, and evaluation methodologies.
• Academic background in social sciences or quality roles is a plus.

Responsibilities

• Support Raters in skill development and best practices for consistent ratings.
• Ensure annotation and gold set creation follow templates and achieve unbiased consensus.
• Analyze datasets to identify patterns and KPI-driven insights.
• Use strategic questioning to gather information and guide problem-solving.
• Create client-focused emails, questions, and feedback.
• Share information with audiences using documentation and clear communication.
• Collaborate with R&D to improve client data.
• Engage with clients and CEM to understand requirements and quality benchmarks.
• Conduct independent evaluations to sustain proficiency.

Skills

German language

English B2

U.S. locale knowledge

Active listening

Effective communication

Proactiveness

Cultural adaptability

Psychological safety

Research skills

Education

Social sciences background

Tools

Google Workspace

Job description

Welo Data seeks an Expert Rater to support and coach fellow Raters, drive quality in AI data for client projects, and mentor teams on rating accuracy. You will guide test rounds, explain templates, and help maintain high standards across diverse datasets.

The role emphasizes cross-functional communication, collaboration with clients and research teams, and ongoing evaluation of performance. Remote, freelance engagement with potential for full-time extension based on outcomes.