Remote Part-Time: AI Response Evaluator & Quality Editor

OpenKrill; United States; Remote; USD 9,600 - 17,000; Part time

Job summary

Anyone AI is seeking a Quality Evaluator (English) to join a remote, independent contractor role. You will compare AI model responses, judge quality on clarity, accuracy, and usefulness, and provide well-reasoned explanations of your evaluations.

The role requires excellent English writing, critical thinking, and extensive hands-on experience with large language models. Remote work offers flexible scheduling for up to 3 months as an independent contractor.

Qualifications

• Fluent English with strong reading and writing skills.
• Hands-on experience using large language models (LLMs).
• Ability to assess multi-dimensional response quality.
• Strong analytical judgment and attention to detail.

Responsibilities

• Interact with AI models and tools across prompts and topics.
• Compare AI-generated responses side-by-side to judge quality.
• Assess accuracy, helpfulness, instruction-following, clarity, and overall quality.
• Follow detailed rating guidelines and evaluation workflows.
• Write clear explanations supporting evaluation decisions.
• Apply evaluation criteria consistently across tasks.

Skills

English fluency

Strong writing skills

Hands-on with LLMs

Analytical judgment

Attention to detail

Follow complex instructions

Explain evaluation decisions

Model/tool switching

Tools

LLMs

Job description

Anyone AI is seeking a Quality Evaluator (English) to join a remote, independent contractor role. You will compare AI model responses, judge quality on clarity, accuracy, and usefulness, and provide well-reasoned explanations of your evaluations.

The role requires excellent English writing, critical thinking, and extensive hands-on experience with large language models. Remote work offers flexible scheduling for up to 3 months as an independent contractor.