AI Instructor – Response evaluation

YPAI; United States; Remote; USD 36,000 - 136,000; Part time

Job summary

YPAI Learn is hiring instructors to teach live online classes that train people to evaluate AI responses against written criteria for accuracy, instruction following, and safety. You will use a ready class kit and teach in English from a remote setup, with sessions paid per class.

Classes last 90 minutes, come with a minute-by-minute plan, slides, notes, a demo grading example, and a backup recording. You’ll pass an instructor test before teaching and sign an agreement covering pay,

Qualifications

• Hands-on experience evaluating AI responses in real work.
• Careful fact-checking against reliable sources.
• Fluent spoken English, teaching in English.
• 18 years or older.

Responsibilities

• Teach live online classes from the class kit.
• Demonstrate how to split prompts into explicit instructions.
• Show how to justify ratings with quotes and sources.
• Guide learners to avoid rating by impression and spot false claims.

Skills

AI evaluation experience

Teaching / training experience

Strong writing skills

Fluent English

Job description

Teach live online classes on grading one AI response against written criteria: accuracy, instruction following and safety, with a justification behind every rating. You teach in English from a ready class kit, remotely, and you are paid for each class you teach.

What the work is for

YPAI Learn trains people for AI evaluation work in live classes. Your classes take learners from a gut feeling about one AI response to a rating they can back with evidence, and teach them to check each factual claim, each instruction in the prompt and each safety concern before they score.

The work

• Teach the live class “Grade an AI response for accuracy and instruction following”, 90 minutes, from the class kit.
• Teach the live class “Rate a response for safety and write the justification”, 90 minutes, from the class kit.
• Show live how you split a prompt into its explicit instructions, check the response against each one and look up its factual claims in a reliable source.
• Walk learners through a justification that names the exact error, quotes the sentence it sits in and explains how much it lowers the rating.
• Help learners who rate on impressions, miss a false claim stated with confidence, or mark a harmless answer as unsafe.

What to expect

• Each class runs live online in English, with learners joining from around the world; the application also asks what other languages you teach in.
• Each class kit gives you a minute-by-minute plan, slides, speaker notes, a demo of grading a sample response and a backup recording of that demo.
• You teach from your own computer, remotely, with a stable connection, a camera, a microphone and a browser for the grading exercise.
• You take and pass the instructor test for a class before you teach it for the first time.
• Before a teaching assignment starts, you sign an instructor agreement. It covers pay, confidentiality and how class material may be used.
• Each invitation states the class times and the price learners pay, and you see both before you accept.

What you bring

• A sample evaluation you wrote on a public or made-up prompt, with ratings and justifications you can show and explain.
• Experience teaching, coaching new evaluators, reviewing other people's ratings or running training sessions.
• Patience with learners who have never had to defend a rating in writing.

You need

• Hands-on experience evaluating AI responses in real work, on AI training projects or for a team that ships AI features.
• Careful fact-checking against reliable sources, and precise writing when you explain a rating.
• Fluent spoken English, the language the classes are taught in.
• 18 years or older.

Good to know

• Where your employment contract asks for approval of outside work, get it in place before you accept an assignment.
• How often you are invited depends on demand for the classes, and each invitation says how much time it is expected to take.
• It is free to apply, and you do not have to buy or take any YPAI Learn course.

Pay

$26-$99/hr. Rate shown is for the United States. This role is open in 4 countries, with local rates; pick your country on YPAI.

YPAI pays every two weeks for approved work via PayPal, Wise or bank transfer. Work is by invitation after your profile is reviewed.