Remote AI Evaluator — Audio, UX, Design

OpenTrain AI, Inc.; United States; Remote; USD 153,000 - 219,000; Part time

Job summary

OpenTrain AI, Inc. is seeking a remote contract evaluator to assess AI-generated work across audio, design, and UX, emphasizing expert judgment and clear standards over production engineering.

You will design scenarios, draft reference answers, develop rubrics, and provide structured feedback. Requires 6–10 years in creative tech, a Bachelor's degree (master's welcomed), and strong writing skills; 20+ hours per week at $135 per hour.

Qualifications

• Six to ten years in creative technology, media, audio, design, UX, or a closely related area.
• Bachelor's degree required; master's degree welcomed.
• Strong writing skills for technical explanations, reference answers, rubrics, and structured feedback.

Responsibilities

• Design realistic technical scenarios and problem sets in your area of creative technology expertise.
• Write expert reference answers that show strong professional judgment.
• Create grading rubrics that separate correct, excellent, and deficient responses.
• Evaluate AI-generated outputs for correctness, depth, and practical domain judgment.
• Write clear technical explanations and structured feedback about evaluation standards.

Skills

Creative technology experience

Writing skills

Experience in design/UX

Education

Bachelor's degree

Master's degree welcomed

Job description

OpenTrain AI, Inc. is seeking a remote contract evaluator to assess AI-generated work across audio, design, and UX, emphasizing expert judgment and clear standards over production engineering.

You will design scenarios, draft reference answers, develop rubrics, and provide structured feedback. Requires 6–10 years in creative tech, a Bachelor's degree (master's welcomed), and strong writing skills; 20+ hours per week at $135 per hour.