Remote English AI Quality Evaluator (Part-Time)

Anyone AI Inc.; Colombia; On-site; COP 30,710,000 - 52,645,000; Part time

Job summary

Anyone AI Inc. seeks a Quality Evaluator – English to help shape the future of AI by evaluating and comparing responses from advanced AI models. This remote, independent contractor role is part-time with a commitment of up to three months and compensation of $7-$12 per hour.

You’ll work from anywhere with an internet connection and contribute to high quality training data. In this role you’ll interact with different models, compare two or more responses side by side, assess accuracy, usefulness,

Qualifications

• Fluent English reading and writing.
• Hands-on experience using LLMs.
• Strong analytical judgment.
• Excellent attention to detail.

Responsibilities

• Interact with different AI models and tools across prompts and topics.
• Compare two or more AI-generated responses side by side.
• Assess accuracy, helpfulness, instruction-following, clarity, and overall response quality.
• Follow detailed rating guidelines and multi-step evaluation workflows.
• Write clear, well-reasoned explanations supporting your evaluation decisions.
• Apply evaluation criteria consistently across tasks.

Skills

Fluency in English

Writing skills

LLM experience

Analytical judgment

Attention to detail

Explain evaluation decisions

Multi-step workflows

Tools

LLMs

Job description

Anyone AI Inc. seeks a Quality Evaluator – English to help shape the future of AI by evaluating and comparing responses from advanced AI models. This remote, independent contractor role is part-time with a commitment of up to three months and compensation of $7-$12 per hour.

You’ll work from anywhere with an internet connection and contribute to high quality training data. In this role you’ll interact with different models, compare two or more responses side by side, assess accuracy, usefulness,