Expert Rater & Mentor for AI Quality — Freelance

Welo Global; España; On-site; EUR 20,000 - 28,000; Full time

Benefits offered by this job

Limitless Flexibility

Limitless Growth

Limitless Support

Job summary

Welo Data is seeking an Expert Rater to mentor and guide fellow raters, improving rating accuracy and decision quality. You will facilitate client test rounds, interpret templates, and ensure alignment with quality benchmarks across the team.

You will coach, monitor progress, and drive data-informed decisions while collaborating with cross‑functional teams to meet client expectations.

Qualifications

• Active listening and empathy to understand stakeholders.
• Clear, respectful written and spoken communication.
• Proactive approach to anticipate needs and problems.
• Ability to adapt to different cultures and teams.
• Fostering psychological safety in collaborative work.
• Strong online research and data interpretation skills.

Responsibilities

• Support raters with development and best practices.
• Guide annotation and gold set creation for unbiased results.
• Analyze data patterns and KPIs to inform decisions.
• Ask strategic questions to aid understanding and decisions.
• Create client communications and feedback materials.
• Explain concepts with clear documentation to clients.
• Collaborate with R&D to improve client data.
• Work with clients and CEM on test rounds and requirements.
• Evaluate independently to maintain skill levels.

Skills

Active listening

Communication skills

Proactiveness

Cultural adaptability

Psychological safety

Research skills

Tools

Google Workspace

Job description

Welo Data is seeking an Expert Rater to mentor and guide fellow raters, improving rating accuracy and decision quality. You will facilitate client test rounds, interpret templates, and ensure alignment with quality benchmarks across the team.

You will coach, monitor progress, and drive data-informed decisions while collaborating with cross‑functional teams to meet client expectations.