AI Quality Evaluator - English (Remote, Part-Time)

Anyone AI Inc.; Argentina; Remote; ARS 14,618,000 - 25,059,000; Part time

Job summary

Anyone AI Inc. is seeking a Quality Evaluator – English to remotely assess and compare responses from advanced AI models.

This independent contractor role involves evaluating model outputs for accuracy, helpfulness, and adherence to instructions, with written explanations to support decisions. You will interact with AI models, perform side-by-side comparisons, and apply detailed rubrics across diverse prompts.

Qualifications

• Fluent English with strong writing and reading skills.
• Extensive hands-on experience using large language models (LLMs).
• Ability to follow complex, multi-step evaluation workflows.

Responsibilities

• Interact with different AI models and tools across prompts and topics.
• Compare two or more AI-generated responses side by side.
• Assess accuracy, usefulness, instruction-following, clarity, and overall quality of responses.
• Follow detailed rating guidelines and evaluation workflows.
• Write clear, well-reasoned explanations supporting evaluation decisions.
• Apply evaluation criteria consistently across tasks.

Skills

English fluency

Strong writing

Critical thinking

LLMs experience

Analytical judgment

Attention to detail

Explain decisions

Multi-step workflows

Tools

LLMs

Job description

Anyone AI Inc. is seeking a Quality Evaluator – English to remotely assess and compare responses from advanced AI models.

This independent contractor role involves evaluating model outputs for accuracy, helpfulness, and adherence to instructions, with written explanations to support decisions. You will interact with AI models, perform side-by-side comparisons, and apply detailed rubrics across diverse prompts.