MSR Project - Chinese Culture Expert

Welocalize, Inc.; United States; Remote; USD 42,000 - 52,000; Part time

Benefits offered by this job

Remote work

Freelance contract

20 hrs/week

Rate $40/h

Job summary

Welocalize, Inc. is seeking Chinese-speaking experts to join a language-evaluation project. You will identify AI model failures, craft queries, test them, and document issues while writing clear instructions and rubrics for correct answers.

The project is remote (Australia-based) on a freelance contract, requiring 20 hours per week at a rate of $40 per hour, with Start ASAP. Prior research/QA/compliance experience and strong attention to detail are preferred.

Qualifications

• Research skills to find and verify information from multiple sources.
• Ability to spot contradictions, outdated information, and locale-specific relevance.
• Attention to detail to catch nuances in language and regional variations.
• Comfort with trial-and-error and iterative testing to identify failures.
• Domain knowledge in research, QA, or compliance is preferred.
• Clear writing to articulate instructions and rubrics clearly.

Responsibilities

• Identify realistic search-related failures where an AI model misleads or responds inadequately.
• Create search queries, test them, document failures, and record findings.
• Write instructions and evaluation criteria for correct answers.
• Note issues like local relevance, source quality, and region-specific applicability.

Skills

Research skills

Critical thinking

Attention to detail

Problem-solving mindset

Writing clarity

Locale knowledge

Job description

Overview

Are you passionate about languages, writing, and quality evaluation? We are launching an exciting language evaluation project and are looking for Chinese-speaking experts to join our team.

What you will do:

Identify realistic search-related failures where an AI model provides inadequate responses. Create search queries, test them, document what went wrong, and write instructions and evaluation criteria for correct answers. Common issues: local relevance, source quality, outdated information, language mismatches, incomplete answers, and region-specific inapplicability. Testing multiple queries before finding failures is expected.

Project Details:

• Start Date: ASAP
• Duration: Ongoing Project.
• Commitment: 20 hours per week.
• Job Type: Freelance contract.
• Location: Remote, Australia
• Rate: $40 per hour.

Requirements:

• Research skills - ability to find and verify information from multiple sources; comfort navigating different websites, databases, and documentation
• Critical thinking - Can spot contradictions between sources, identify outdated information, and recognize when something doesn't apply to a specific locale/context
• Attention to detail - Can catch nuances in language, local variations (prices, regulations, requirements), and edge cases
• Problem-solving mindset - Comfortable iterating and testing when things don't work; doesn't get frustrated by trial- and-error
• Domain knowledge - Ideally someone with background in research, quality assurance, compliance, or similar work that requires precision and source verification
• Writing clarity - Can articulate instructions and rubrics clearly so others understand the logic behind their reasoning
• Locale knowledge - Deep familiarity with their specific locale (local regulations, business practices, cultural nuances) is valuable for spotting region-specific failures