AI Response Quality Analyst (Remote, Part-Time)

Anyone AI Inc.; United States; Remote; CLP 9,510,000 - 16,303,000; Part time

Job summary

Anyone AI Inc. is seeking a Quality Evaluator – English to help shape the future of AI safety and usefulness. This remote, independent contractor role requires fluent English, strong writing, and sharp critical thinking to evaluate responses from frontier AI models.

You will compare two or more model outputs side by side, assess accuracy, usefulness, and instruction adherence, and provide clear explanations. Part-time, up to 3 months, $7–$12/hour.

Qualifications

• Fluent in English with strong reading and writing skills.
• Proven ability to evaluate model outputs with clarity and objectivity.
• Experience with multiple prompts and instruction-following assessments.

Responsibilities

• Interact with various AI models and evaluation tools across diverse prompts.
• Compare multiple AI-generated responses side by side to assess quality.
• Rate accuracy, usefulness, instruction adherence, and clarity.
• Follow detailed evaluation guidelines and document reasoning.
• Explain evaluation decisions clearly and convincingly.

Skills

English fluency

Strong writing skills

Critical thinking

Analytical judgment

Attention to detail

Tools

Large Language Models (LLMs)

Evaluation tools

Job description

Anyone AI Inc. is seeking a Quality Evaluator – English to help shape the future of AI safety and usefulness. This remote, independent contractor role requires fluent English, strong writing, and sharp critical thinking to evaluate responses from frontier AI models.

You will compare two or more model outputs side by side, assess accuracy, usefulness, and instruction adherence, and provide clear explanations. Part-time, up to 3 months, $7–$12/hour.