Remote AI Quality Evaluator (English) - Part-Time

Anyone AI Inc.; United States; Remote; USD 9,600 - 17,000; Part time

Job summary

Anyone AI Inc. is seeking a Quality Evaluator for English to help shape AI quality by assessing and comparing model responses. This remote, part-time contractor role spans up to 3 months, with compensation of $7-$12 per hour.

You will interact with multiple AI models, compare responses side by side, and judge accuracy, helpfulness, instruction-following, clarity, and overall quality. You will also write clear explanations and follow detailed rating guidelines to improve AI systems.

Qualifications

• Fluency in English with strong reading and writing skills.
• Extensive hands-on experience using LLMs and critically assessing outputs.
• Strong analytical judgment and the ability to weigh multiple dimensions of response quality.
• Excellent attention to detail and ability to follow complex instructions carefully.
• Ability to explain evaluation decisions clearly and convincingly.
• Comfort switching between AI models, tools, and multi-step workflows.

Responsibilities

• Interact with different AI models and tools across prompts and topics.
• Compare two or more AI-generated responses side by side.
• Assess accuracy, helpfulness, instruction-following, clarity, and overall response quality.
• Follow detailed rating guidelines and multi-step evaluation workflows.
• Write clear, well-reasoned explanations supporting your evaluation decisions.
• Apply evaluation criteria consistently across tasks.

Skills

English fluency

Writing skills

LLM experience

Analytical judgment

Attention to detail

Explain decisions

Multi-model workflows

Job description

Anyone AI Inc. is seeking a Quality Evaluator for English to help shape AI quality by assessing and comparing model responses. This remote, part-time contractor role spans up to 3 months, with compensation of $7-$12 per hour.

You will interact with multiple AI models, compare responses side by side, and judge accuracy, helpfulness, instruction-following, clarity, and overall quality. You will also write clear explanations and follow detailed rating guidelines to improve AI systems.