Javanese Speakers — Contribute to AI LLM Evaluation!

Medium; Remote; IDR 300.000.000 - 400.000.000; Part time

Job summary

A leading multilingual AI project is seeking individuals to join Project Spearmint, focusing on evaluating AI model outputs in Javanese. Responsibilities include reviewing datasets for tone and fluency, rating responses, and providing rationales for evaluations. Candidates must have native-level fluency in Javanese and strong English comprehension. This project offers work-from-home flexibility, requiring a commitment of 25 hours per week. Apply today to make an impact in the AI landscape!

Benefits

Flexible hours

Work from home

Impactful contribution to AI development

Qualifications

• Must have native fluency in Javanese language.
• Strong understanding of English language is essential.
• Reside in Indonesia and able to commit to 25 hours per week.

Responsibilities

• Review datasets for tone and fluency.
• Rate model-generated replies using a five-point scale.
• Provide rationales for ratings, especially extreme ones.

Skills

Native-level fluency in Javanese

Strong comprehension of English

Job description

Join Project Spearmint — a multilingual AI response evaluation project focused on reviewing large language model (LLM) outputs in different languages!

Why Join?

• Shape the future of AI in your native language.
• Work from home with flexible hours.
• Contribute to advancing cutting-edge language model development.

What You’ll Do

• Review short, pre-segmented datasets.
• Evaluate model-generated replies based on Tone or Fluency.
• Read a user prompt and two model replies, then rate each using a five-point scale.
• Provide short rationales for extreme ratings.

Project Breakdown

Batch 1 – Tone

Determine if replies are helpful, engaging, fair, and appropriately formal. Flag issues such as condescension, bias, or tonal mismatches.

Batch 2 – Fluency

Assess grammatical accuracy, clarity, coherence, and natural flow.

Requirements

• Native-level fluency in Javanese language.
• Strong comprehension of English.
• Residing in Indonesia.
• Can commit to working 25 hours per week.

Payment Details

This is a project-based opportunity with CrowdGen. Payment details will be provided upon selection.

How to Get Started

• Apply to Project Spearmint.
• If selected, you will receive an email from CrowdGen to create your account.
• Log in, reset your password, and complete the setup requirements.
• Start the qualification process: estimated qualification duration: 30–40 minutes.

Important Note

This opportunity is limited, and assignments are made on a rolling basis. Apply early to maximize your chances of being selected.

Make an impact on the future of AI — apply today and contribute from the comfort of your home!