Chinese Culture QA Researcher (Remote Australia)

Welocalize, Inc.; Sydney; Remote; AUD 47,000 - 63,000; Part time

Job summary

Welocalize, Inc. is seeking Chinese-speaking experts to participate in a language evaluation project. You will identify failures in AI responses, craft search queries, test them, and document findings with clear evaluation criteria.

The role emphasizes accuracy, attention to locale-specific details, and the ability to produce precise instructions for evaluation rubrics. This is a remote freelance contract based in Australia with 20 hours per week commitment.

Qualifications

• Ability to research and verify information from multiple sources.
• Identify outdated information and locale-specific nuances.
• Spot contradictions and assess relevancy across locales.
• Strong attention to language nuance and regional pricing.
• Excellent written instructions and rubrics.
• Comfort with iterative testing and troubleshooting.
• Knowledge in research, QA, or compliance.

Responsibilities

• Identify realistic search-related failures where an AI model provides inadequate responses.
• Create search queries, run tests, and document results.
• Write clear evaluation criteria and scorer rubrics for correct answers.

Skills

Research skills

Critical thinking

Attention to detail

Problem-solving mindset

Domain knowledge

Writing clarity

Locale knowledge

Job description

Welocalize, Inc. is seeking Chinese-speaking experts to participate in a language evaluation project. You will identify failures in AI responses, craft search queries, test them, and document findings with clear evaluation criteria.

The role emphasizes accuracy, attention to locale-specific details, and the ability to produce precise instructions for evaluation rubrics. This is a remote freelance contract based in Australia with 20 hours per week commitment.