Dutch Expert Rater

Welo Data; Amsterdam; On-site; EUR 28,000 - 38,000; Full time

Job summary

Welo Data seeks a detail-oriented freelancer to support Dutch-language annotation for AI quality assessment. The role focuses on rating data, guiding raters, and creating client-ready communications to ensure accurate results.

You will analyze datasets, apply labeling templates, and perform tier-2 reviews while collaborating with R&D and client teams to meet quality benchmarks. Starts 27 July, 30-hr/week project with potential extension based on performance.

Qualifications

• Knowledge of Dutch language required.
• Knowledge of English B2 (oral and written comprehension).
• 1+ years of rating experience required.
• Understanding of data labeling, annotation, and evaluation methodologies required.

Responsibilities

• Support Raters in skill development, guiding them in best practices for accurate and consistent ratings.
• Ensure annotation selection and gold set creation adheres to template instructions, guaranteeing unbiased outcomes.
• Analyze diverse datasets to identify patterns and trends, using KPIs to drive data-informed decisions.
• Employ strategic questioning to gather information and stimulate critical thinking for problem solving.
• Craft client-ready written materials such as emails and feedback.
• Facilitate information with documentation to align with client objectives.
• Collaborate with R&D teams on experiments to enhance client data.
• Work with clients and CEM to conduct test rounds and understand quality benchmarks.
• Conduct evaluations independently to maintain proficiency and improve projects.
• Perform tier 2 reviews to identify patterns and opportunities.

Skills

Dutch language

English B2

Rating experience

Data labeling

Evaluation methodologies

Active listening

Communication

Proactiveness

Cultural adaptability

Psychological safety

Research skills

Job description

What if your knowledge of Dutch language could help improve the AI.

PROJECT DETAILS

• Language: Dutch
• Location: Netherlands
• Hourly Rate: $28/hour
• Capacity: 30 hours/week (with the possibility of an extension to 40hours/week)
• Project Duration: 1 Month
• Employment Type: Freelance (with the possibility of a Full-time employment extension based on performance and project needs)
• Start Date: 27th July

What You’ll Do

• Support Raters in skill development, guiding them in best practices for accurate and consistent ratings.
• Ensure annotation selection and gold set creation adheres to template instructions, guaranteeing unbiased outcomes that are reached through elaborate peer-driven consensus.
• Analyze diverse datasets to identify significant patterns and trends, demonstrating proficiency in interpreting and utilizing KPIs to drive data-informed decision-making.
• Employ strategic questioning techniques to gather information, enhance understanding, and stimulate critical thinking for effective problem-solving and decision-making.
• Craft written materials such as emails, questions, and feedback specifically customized for client communication, ensuring clarity and relevance.
• Facilitate information or concepts to audiences using relevant documentation and clear communication strategies to align with specific client objectives.
• Collaborate with research and development teams in experiments aimed at enhancing the client's data.
• Work closely with clients and CEM to conduct test rounds, gain insights into their requirements, and understand the quality benchmarks expected.
• Conduct evaluations independently to sustain and enhance the level of proficiency or skill in particular projects.
• Conduct thorough tier 2 reviews to identify patterns and gain insights into areas of opportunity.

YOU ARE A FIT IF YOU HAVE

• Knowledge of Dutch Language Required
• Knowledge of English B2 - Required (Oral and written comprehension)
• 1+ years of rating experience - Required
• Understanding of data labeling, annotation, and evaluation methodologies - Required
• An academic background in social sciences or quality roles is a plus
• Active Listening Skills: Engage with speakers attentively, seek clarification, provide feedback, and demonstrate empathy to comprehend their message deeply.
• Effective Communication and Empathy: Clearly express thoughts, emotions, and needs while respecting others' perspectives, communicating assertively yet respectfully.
• Proactiveness: Anticipate and prepare for future needs or obstacles to tackle them efficiently before they arise.
• Cultural Adaptability: Navigate differences in values, behaviors, and communication styles to foster effective interactions in diverse cultural contexts.
• Psychological Safety Cultivation: Create an atmosphere where individuals feel safe expressing themselves, taking risks, and sharing ideas without fear of criticism.
• Research Skills: Methodically explore online sources to extract data, insights, or knowledge relevant to specific topics and cross-reference information.