Remote Multilingual AI Response Evaluator & Rubric

aitrainer; United States; Remote; USD 21,000 - 34,000; Full time

Benefits offered by this job

Fully remote

Job summary

Meteor in the AI/ML Training domain invites professionals to evaluate multilingual reference responses and scoring rubrics, identify critical errors, and help raise evaluation quality.

The role offers flexible remote work across seven languages and locations, focusing on careful, consistent judgment and adherence to detailed instructions. Prior exposure to medical, financial, or legal topics is a plus.

Remote work is supported globally with a fixed hourly rate and a focus on quality over speed.

Qualifications

• Native-level fluency in one of the available project languages.
• Strong reading comprehension and written communication.
• Attention to detail and careful judgment.
• Basic familiarity with medical, financial, and legal topics.
• Ability to follow detailed instructions carefully.

Responsibilities

• Evaluate multilingual AI reference responses and scoring rubrics.
• Identify critical errors and improve evaluation quality.
• Support both open-ended and closed-ended tasks.
• Work remotely across language and location options.

Skills

Native-level fluency

Reading comprehension

Written communication

Attention to detail

Follow detailed instructions

Reliable internet

Job description

Meteor in the AI/ML Training domain invites professionals to evaluate multilingual reference responses and scoring rubrics, identify critical errors, and help raise evaluation quality.

The role offers flexible remote work across seven languages and locations, focusing on careful, consistent judgment and adherence to detailed instructions. Prior exposure to medical, financial, or legal topics is a plus.

Remote work is supported globally with a fixed hourly rate and a focus on quality over speed.