Quality Evaluator – English (Fully Remote)

Anyone AI Inc.; United States; Remote; USD 28,000 - 48,000; Full time

Job summary

Anyone AI is seeking remote independent contractors to help create and evaluate data for frontier AI models. You will interact with AI models and compare responses to ensure quality and reliability.

Responsibilities include assessing accuracy, helpfulness, and instruction-following while following detailed rating guidelines and multi-step workflows. Fluency in English and strong analytical judgment are essential, with experience in AI evaluation or QA considered a plus.

Qualifications

• Fluent in English with strong analytical judgment.
• Extensive hands-on experience with LLMs and AI models.
• Ability to follow detailed evaluation guidelines and workflows.

Responsibilities

• Assess accuracy, helpfulness, and instruction-following of AI outputs.
• Follow rating guidelines and multi-step workflows.
• Collaborate with team to improve evaluation processes.

Skills

Fluency in English

Analytical judgment

LLM experience

Job description

• We create high-quality training and evaluation data for frontier AI models.
• You'll interact directly with AI models and compare responses.

What you'll do:

• Assess accuracy, helpfulness, and instruction-following.
• Follow detailed rating guidelines and multi-step workflows.

What we're looking for:

• Fluency in English and strong analytical judgment.
• Extensive hands-on experience with LLMs and attention to detail.

Nice to have:

• Experience in AI evaluation, data annotation, or QA.
• Familiarity with editing, research, and fact-checking.

Anyone AI

Anyone AI creates high-quality training and evaluation data for frontier AI models. They work with remote independent contractors, focusing on expert human evaluation to improve AI accuracy and reliability.