English AI Evaluation Specialist (Remote)

Anyone AI Inc.; United States; Remote; USD 9,600 - 17,000; Part time

Job summary

Anyone AI Inc. is seeking a Quality Evaluator – English to help shape AI model outputs. This remote, part-time role involves evaluating and comparing responses from advanced AI models, writing clear explanations, and following multi-step workflows.

You will interact with multiple AI models, assess accuracy and usefulness, and maintain consistent evaluation standards. The position demands excellent English writing and critical thinking, with a focus on high-quality data for model improvement.

Qualifications

• Fluency in English with strong reading and writing skills.
• Extensive hands-on experience using large language models (LLMs).
• Strong analytical judgment and the ability to weigh multiple dimensions of response quality.
• Excellent attention to detail and ability to follow complex instructions.
• Ability to clearly and convincingly explain evaluation decisions.
• Comfort switching between AI models, tools, and multi-step workflows.

Responsibilities

• Interact with different AI models and tools across prompts and topics.
• Compare two or more AI-generated responses side by side.
• Assess accuracy, helpfulness, instruction-following, clarity, and overall quality.
• Follow detailed rating guidelines and multi-step evaluation workflows.
• Write clear, well-reasoned explanations supporting evaluation decisions.
• Apply evaluation criteria consistently across tasks.

Skills

English fluency

LLM experience

Analytical judgment

Attention to detail

Explain decisions

Multimodal workflows

Job description

Anyone AI Inc. is seeking a Quality Evaluator – English to help shape AI model outputs. This remote, part-time role involves evaluating and comparing responses from advanced AI models, writing clear explanations, and following multi-step workflows.

You will interact with multiple AI models, assess accuracy and usefulness, and maintain consistent evaluation standards. The position demands excellent English writing and critical thinking, with a focus on high-quality data for model improvement.