Expert Rater & Coach for AI Quality — Freelance

Welocalize, Inc.

United States

Remote

USD 24,000 - 34,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Flexibility
Global collaboration
Learning opportunities

Job summary

Welo Data, part of Welocalize, seeks an Expert Rater to support Raters, guide rating quality, and participate in client test rounds. You will help cascade quality expectations, coach peers, and monitor progress to meet client goals.

You will analyze datasets, craft client communications, and collaborate with R&D and CEM to improve data quality for our AI-driven systems. Remote or flexible engagement offered in a freelance capacity.

Qualifications

  • Engage with speakers attentively and provide constructive feedback.
  • Respect diverse viewpoints and communicate clearly.
  • Anticipate needs and prepare for obstacles.
  • Navigate cultural differences to foster effective interactions.
  • Create a safe environment for ideas and risk-taking.
  • Methodically explore online sources to extract relevant data.

Responsibilities

  • Support Raters in skill development and best practices for consistent ratings.
  • Ensure annotation selection and gold set creation follow templates and allow peer consensus.
  • Analyze datasets to identify patterns and drive data-informed decisions.
  • Ask strategic questions to enhance understanding and problem-solving.
  • Craft client-ready emails, questions, and feedback with clarity.
  • Present concepts using documentation to align with client objectives.
  • Collaborate with R&D to improve client data quality.
  • Work with clients and CEM to conduct test rounds and capture requirements.
  • Conduct independent evaluations to sustain high proficiency.

Skills

Active Listening
Effective Communication
Proactiveness
Cultural Adaptability
Psychological Safety
Research Skills

Education

Social sciences background

Tools

Google Workspace

Job description

Welo Data, part of Welocalize, seeks an Expert Rater to support Raters, guide rating quality, and participate in client test rounds. You will help cascade quality expectations, coach peers, and monitor progress to meet client goals.

You will analyze datasets, craft client communications, and collaborate with R&D and CEM to improve data quality for our AI-driven systems. Remote or flexible engagement offered in a freelance capacity.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Expert Rater & Coaching Specialist (German)
Expert Rater & Coaching Specialist (German)

Remote • San Francisco (CA)

Remote
USD 22,000 - 32,000
Limitless Flexibility
Limitless Growth
Limitless Support
Remote-Friendly: Expert Rater (French) – Freelance
Remote-Friendly: Expert Rater (French) – Freelance

Remote • San Francisco (CA)

On-site
USD 25,000 - 36,000
Flexible schedule
Career growth
Global community support
AI Rater Mentor & Quality Assurance Coach
AI Rater Mentor & Quality Assurance Coach

Welocalize • United States

Remote
USD 6,900 - 11,000
Limitless Flexibility
Limitless Growth
Limitless Support
Expert Rater Project - English (India)
Expert Rater Project - English (India)

Welocalize • United States

Remote
USD 6,900 - 11,000
Limitless Flexibility
Limitless Growth
Limitless Support
Expert Rater Project - Italian
Expert Rater Project - Italian

Remote • San Francisco (CA)

Remote
USD 23,000 - 33,000
Expert Rater Project - Dutch (Netherlands)
Expert Rater Project - Dutch (Netherlands)

Welocalize • United States

Remote
USD 32,000 - 45,000
Limitless Flexibility
Limitless Growth
Limitless Support
Expert Rater Project - German (Spain)
Expert Rater Project - German (Spain)

Remote • San Francisco (CA)

Remote
USD 22,000 - 32,000
Limitless Flexibility
Limitless Growth
Limitless Support
Expert Rater Project - French
Expert Rater Project - French

Welocalize, Inc. • United States

Remote
USD 24,000 - 34,000
Flexibility
Global collaboration
Learning opportunities
Expert Rater Project - French (Spain)
Expert Rater Project - French (Spain)

Remote • San Francisco (CA)

On-site
USD 25,000 - 36,000
Flexible schedule
Career growth
Global community support
Expert Rater Project - French (Spain)
Expert Rater Project - French (Spain)

Welocalize • United States

Remote
USD 22,000 - 32,000
Limitless Flexibility
Limitless Growth
Limitless Support