AI Response Evaluator (Remote, 3-Month)

Anyone AI Inc.; Colombia; Remote; COP 30,692,000 - 52,615,000; Full time

Job summary

Anyone AI Inc. is hiring remote contractors to help shape AI evaluation data. You will assess and compare responses from frontier AI models to determine which best meets user needs.

We seek English-fluent experts with strong writing, critical thinking, and hands-on experience with large language models. This role involves detailed evaluations, explanations, and following multi-step workflows, with compensation of $7–$12 per hour for up to 3 months.

Qualifications

• English fluency with strong reading and writing skills.
• Hands-on experience using large language models (LLMs).
• Strong analytical judgment and ability to compare model outputs.
• Excellent attention to detail and ability to follow instructions.

Responsibilities

• Interact with multiple AI models and tools on varied prompts.
• Compare AI-generated responses side by side for evaluation.
• Assess accuracy, usefulness, instruction-following, and clarity.
• Follow rating guidelines and multi-step evaluation workflows.
• Provide clear, well-reasoned explanations for decisions.

Skills

English fluency

Writing skills

Critical thinking

Attention to detail

Tools

LLM experience

Evaluation tools

Job description

Anyone AI Inc. is hiring remote contractors to help shape AI evaluation data. You will assess and compare responses from frontier AI models to determine which best meets user needs.

We seek English-fluent experts with strong writing, critical thinking, and hands-on experience with large language models. This role involves detailed evaluations, explanations, and following multi-step workflows, with compensation of $7–$12 per hour for up to 3 months.