Expert Rater & Quality Mentor for AI Systems

aitrainer; España; Presencial; EUR 31.366 - 37.398; A tiempo parcial

Descripción de la vacante

aitrainer seeks an Expert Rater to coach fellow Raters, improve rating accuracy, and guide decision-making. You will support client test rounds and translate templates into actionable workflows.

You will collaborate with clients and CEM, analyze data and KPIs, and develop clear communications. The role offers a freelance arrangement with extension potential, 30 hours/week, starting July 27.

Formación

• Active listening and communication skills to enable effective coaching and guidance.
• Empathy and stakeholder management to guide Raters and ensure fair evaluations.
• Proactive approach to anticipate needs and prepare support materials in advance.
• Cultural adaptability across diverse teams to improve collaboration and outcomes.
• Psychological safety cultivation to foster open feedback and learning.
• Research skills to extract insights from datasets and apply them to rating processes.

Responsabilidades

• Support Raters in skill development and best practices for accurate and consistent ratings.
• Ensure annotation and gold set creation adhere to templates and are unbiased via peer review.
• Analyze diverse datasets to identify patterns and KPIs for data-informed decisions.
• Use strategic questioning to gather information and improve problem solving.
• Craft client-facing emails, questions, and feedback with clarity and relevance.
• Collaborate with research and development teams on experiments to improve client data.
• Work with clients and CEM to conduct test rounds and understand quality benchmarks.
• Conduct evaluations and tier 2 reviews to identify opportunities and improve proficiency.

Conocimientos

Active Listening

Empathy

Proactiveness

Cultural Adaptability

Psychological Safety

Research Skills

Educación

Social sciences background

Quality roles background

Herramientas

Google Workspace

Descripción del empleo

aitrainer seeks an Expert Rater to coach fellow Raters, improve rating accuracy, and guide decision-making. You will support client test rounds and translate templates into actionable workflows.

You will collaborate with clients and CEM, analyze data and KPIs, and develop clear communications. The role offers a freelance arrangement with extension potential, 30 hours/week, starting July 27.