Remote English AI Quality Evaluator

Anyone AI Inc.; United States; Presencial; USD 9600 - 17 000; Tempo parcial

Resumo da oferta

Anyone AI Inc. is seeking a Quality Evaluator – English to help shape the future of AI by evaluating and comparing responses from advanced AI models. This is a remote, independent contractor role with part-time hours, up to 3 months.

You will review AI outputs for accuracy, helpfulness, and instruction-following, provide clear explanations, and apply multi-step evaluation workflows across diverse prompts. Fluency in English and strong writing are essential.

Qualificações

• Fluent in English with strong writing skills.
• Hands-on experience using large language models (LLMs).
• Strong analytical judgment and ability to weigh multiple dimensions of response quality.
• Excellent attention to detail and ability to follow complex instructions.
• Ability to explain evaluation decisions clearly.
• Comfort switching between AI models, tools, and multi-step workflows.

Responsabilidades

• Interact with different AI models and tools across prompts and topics.
• Compare two or more AI-generated responses side by side.
• Assess accuracy, helpfulness, instruction-following, clarity, and overall response quality.
• Follow detailed rating guidelines and multi-step evaluation workflows.
• Write clear, well-reasoned explanations supporting your evaluation decisions.
• Apply evaluation criteria consistently across tasks.

Conhecimentos

Writing skills

Critical thinking

Analytical judgment

Attention to detail

LLM experience

Communication

Instruction following

Ferramentas

AI models

Evaluation tools

Side-by-side comparison

Descrição da oferta de emprego

Anyone AI Inc. is seeking a Quality Evaluator – English to help shape the future of AI by evaluating and comparing responses from advanced AI models. This is a remote, independent contractor role with part-time hours, up to 3 months.

You will review AI outputs for accuracy, helpfulness, and instruction-following, provide clear explanations, and apply multi-step evaluation workflows across diverse prompts. Fluency in English and strong writing are essential.