Remote AI Evaluation Specialist

Anyone AI Inc.; United States; Remote; USD 28,000 - 48,000; Full time

Job summary

Anyone AI is seeking remote independent contractors to help create and evaluate data for frontier AI models. You will interact with AI models and compare responses to ensure quality and reliability.

Responsibilities include assessing accuracy, helpfulness, and instruction-following while following detailed rating guidelines and multi-step workflows. Fluency in English and strong analytical judgment are essential, with experience in AI evaluation or QA considered a plus.

Qualifications

• Fluent in English with strong analytical judgment.
• Extensive hands-on experience with LLMs and AI models.
• Ability to follow detailed evaluation guidelines and workflows.

Responsibilities

• Assess accuracy, helpfulness, and instruction-following of AI outputs.
• Follow rating guidelines and multi-step workflows.
• Collaborate with team to improve evaluation processes.

Skills

Fluency in English

Analytical judgment

LLM experience

Job description

Anyone AI is seeking remote independent contractors to help create and evaluate data for frontier AI models. You will interact with AI models and compare responses to ensure quality and reliability.

Responsibilities include assessing accuracy, helpfulness, and instruction-following while following detailed rating guidelines and multi-step workflows. Fluency in English and strong analytical judgment are essential, with experience in AI evaluation or QA considered a plus.