Remote AI Training & Evaluation Specialist

S27a; Northern (KY); Hybrid; USD 28,000 - 55,000; Part time

Job summary

S27a is seeking an English Speaking Generalist for a remote contract role. You will train next-generation AI systems by creating diverse prompts and evaluating outputs from ChatGPT, Claude, and others. The role emphasizes clear American English feedback, attention to detail, and high-quality documentation.

Prior AI experience not required; domain knowledge matters. The position is remote with flexible scheduling and a focus on thorough, structured feedback and professional communication across

Qualifications

• Domain knowledge in AI evaluation is valued.
• Strong attention to detail and clear documentation interpretation are essential.
• Ability to provide structured verbal feedback in American English.

Responsibilities

• Create diverse prompts to challenge large language models.
• Submit identical prompts to both ChatGPT and Claude, recording your screen and microphone during the process.
• Verbally articulate comparisons and evaluate outputs from both models in real time, highlighting strengths, weaknesses, and key differences.
• Provide detailed, structured verbal feedback in clear American English, explaining your reasoning and preferences.
• Maintain clarity and professionalism in both spoken and written communication throughout each recording session.
• Interpret provided documentation to ensure consistent evaluation standards and accurate project delivery.
• Collaborate closely with project guidelines to support continuous improvement of AI models.

Skills

AI training

AI Response Evaluation

Critical Thinking & Analytical Reason

Attention to Detail

Documentation Interpretation

Job description

S27a is seeking an English Speaking Generalist for a remote contract role. You will train next-generation AI systems by creating diverse prompts and evaluating outputs from ChatGPT, Claude, and others. The role emphasizes clear American English feedback, attention to detail, and high-quality documentation.

Prior AI experience not required; domain knowledge matters. The position is remote with flexible scheduling and a focus on thorough, structured feedback and professional communication across