English-Speaking AI Social-Context Response Evaluator

OpenTrain AI, Inc.; United Kingdom; Remote; GBP 11,000 - 23,000; Part time

Job summary

OpenTrain AI, Inc. seeks evaluators to design social-context scenarios and interact with a language model under defined conditions. You will judge responses for relevance, usefulness, personalization, clarity, and alignment with the scenario, and provide detailed justification for each rating.

This is a short-term contractor pilot with pay per task, running for 2 to 3 weeks. Candidates should be fluent in written English, capable of clear communication, and experienced in human-AI interaction or

Qualifications

• Fluent written English and clear communication skills.
• Experience in human-AI interaction, data annotation, image or video annotation, content evaluation, or a similar analytical project.

Responsibilities

• Create personal, professional, and interpersonal scenarios that give the model meaningful context.
• Interact with the language model under the conditions assigned for the evaluation.
• Rate responses for relevance, usefulness, personalization, clarity, and alignment with the scenario.
• Write detailed reasons that explain each rating.

Skills

Creative thinking

Analytical thinking

Sound judgment

Interpersonal context

Detailed writing

Guideline consistency

Job description

The Work

You will assess how social context affects the advice produced by a language model. You will create realistic scenarios, interact with the model under assigned conditions, and judge whether its responses fit the situation.

For each evaluation, you will explain your ratings in clear written English. You will follow project guidelines, use consistent judgment, and complete assigned tasks within the required timeline.

• Create personal, professional, and interpersonal scenarios that give the model meaningful context.
• Interact with the language model under the conditions assigned for the evaluation.
• Rate responses for relevance, usefulness, personalization, clarity, and alignment with the scenario.
• Write detailed reasons that explain each rating.

What It Pays and Takes

This is a short-term contractor pilot with pay per task. The project is expected to run for 2 to 3 weeks.

• Pay: Per task; the listing does not provide a rate.
• Time: 20 or more hours per week.
• Location: Open worldwide.
• Language: Fluent written English and clear communication skills.
• Experience: Experience in human-AI interaction, data annotation, image or video annotation, content evaluation, or a similar analytical project is required.
• Skills: Creative and analytical thinking, sound judgment with nuanced interpersonal context, objective evaluation, detailed writing, and consistent use of guidelines.
• Preferred: Business analysis experience.

About AI Training Work

AI training is the human work behind systems that learn from examples and feedback. Evaluators review model responses and explain what works or fails, helping improve how AI handles real requests and context.