AI Social-Context Response Evaluator (Contractor)

OpenTrain AI, Inc.; United Kingdom; Remote; GBP 11,000 - 23,000; Part time

Job summary

OpenTrain AI, Inc. seeks evaluators to design social-context scenarios and interact with a language model under defined conditions. You will judge responses for relevance, usefulness, personalization, clarity, and alignment with the scenario, and provide detailed justification for each rating.

This is a short-term contractor pilot with pay per task, running for 2 to 3 weeks. Candidates should be fluent in written English, capable of clear communication, and experienced in human-AI interaction or

Qualifications

• Fluent written English and clear communication skills.
• Experience in human-AI interaction, data annotation, image or video annotation, content evaluation, or a similar analytical project.

Responsibilities

• Create personal, professional, and interpersonal scenarios that give the model meaningful context.
• Interact with the language model under the conditions assigned for the evaluation.
• Rate responses for relevance, usefulness, personalization, clarity, and alignment with the scenario.
• Write detailed reasons that explain each rating.

Skills

Creative thinking

Analytical thinking

Sound judgment

Interpersonal context

Detailed writing

Guideline consistency

Job description

OpenTrain AI, Inc. seeks evaluators to design social-context scenarios and interact with a language model under defined conditions. You will judge responses for relevance, usefulness, personalization, clarity, and alignment with the scenario, and provide detailed justification for each rating.

This is a short-term contractor pilot with pay per task, running for 2 to 3 weeks. Candidates should be fluent in written English, capable of clear communication, and experienced in human-AI interaction or