Remote AI Evaluation Instructor (Live Online)

YPAI; United States; Remote; USD 36,000 - 136,000; Full time

Job summary

YPAI Learn is seeking remote live instructors to teach AI evaluation concepts in English. You will guide learners through pairing responses, weighing flaws, and explaining how preferences train reward models and influence RLHF in real systems.

Each class uses a ready kit with plans, slides, and speaker notes, and pay is per invited class. Classes are online, with a flexible schedule and topics covering pairwise comparisons, reward-model training, and methods like DPO.

Qualifications

• Hands-on pairwise comparison or preference ranking work on real AI training or evaluation projects.
• Experience teaching, leading calibration sessions for raters, mentoring reviewers or explaining machine learning to non-specialists.
• Fluent spoken English; instruction in English.

Responsibilities

• Teach live class “Choose the better of two AI responses and justify the preference”, 90 minutes, from the class kit.
• Teach live class “Trace how preference pairs train a reward model”, 90 minutes, from the class kit.
• Show live a comparison where both responses have flaws and explain the strength of the preference.
• Walk learners through how a preference pair guides a reward model and how methods like DPO use the pairs.
• Assist learners who flip choices or call ties to avoid decisive bias.

Skills

Pairwise comparison

Teaching experience

Fluent English

Patience with learners

Job description

YPAI Learn is seeking remote live instructors to teach AI evaluation concepts in English. You will guide learners through pairing responses, weighing flaws, and explaining how preferences train reward models and influence RLHF in real systems.

Each class uses a ready kit with plans, slides, and speaker notes, and pay is per invited class. Classes are online, with a flexible schedule and topics covering pairwise comparisons, reward-model training, and methods like DPO.