AI Response Quality Evaluator (English)

Anyone AI Inc.; United States; On-site; USD 9,600 - 17,000; Part time

Benefits offered by this job

Remote work

Contractor role

Up to 3 months

Job summary

Anyone AI Inc. seeks a Quality Evaluator – English to help shape the future by evaluating AI model responses. This is a remote, part-time independent contractor role with a short commitment.

You will compare outputs from different models, assess accuracy and clarity, and write clear explanations to guide improvements in AI systems. Fluency in English and hands-on experience with LLMs are essential.

Qualifications

• Fluency in English with strong reading and writing skills.
• Extensive hands-on experience using large language models (LLMs) and critically assessing outputs.
• Strong analytical judgment and ability to weigh multiple dimensions of response quality.

Responsibilities

• Interact with different AI models and tools across prompts and topics.
• Compare two or more AI-generated responses side by side.
• Assess accuracy, helpfulness, instruction-following, clarity, and overall response quality.
• Follow detailed rating guidelines and multi-step evaluation workflows.
• Write clear, well-reasoned explanations supporting evaluation decisions.
• Apply evaluation criteria consistently across tasks.

Skills

Fluent English

LLM evaluation

Analytical judgment

Attention to detail

Explain evaluation decisions

Multi‑step workflows

Tools

LLMs

Job description

Anyone AI Inc. seeks a Quality Evaluator – English to help shape the future by evaluating AI model responses. This is a remote, part-time independent contractor role with a short commitment.

You will compare outputs from different models, assess accuracy and clarity, and write clear explanations to guide improvements in AI systems. Fluency in English and hands-on experience with LLMs are essential.