Creative Technologist (Audio, Design, UX)

OpenTrain AI, Inc.; United States; Remote; USD 153,000 - 219,000; Part time

Job summary

OpenTrain AI, Inc. is seeking a remote contract evaluator to assess AI-generated work across audio, design, and UX, emphasizing expert judgment and clear standards over production engineering.

You will design scenarios, draft reference answers, develop rubrics, and provide structured feedback. Requires 6–10 years in creative tech, a Bachelor's degree (master's welcomed), and strong writing skills; 20+ hours per week at $135 per hour.

Qualifications

• Six to ten years in creative technology, media, audio, design, UX, or a closely related area.
• Bachelor's degree required; master's degree welcomed.
• Strong writing skills for technical explanations, reference answers, rubrics, and structured feedback.

Responsibilities

• Design realistic technical scenarios and problem sets in your area of creative technology expertise.
• Write expert reference answers that show strong professional judgment.
• Create grading rubrics that separate correct, excellent, and deficient responses.
• Evaluate AI-generated outputs for correctness, depth, and practical domain judgment.
• Write clear technical explanations and structured feedback about evaluation standards.

Skills

Creative technology experience

Writing skills

Experience in design/UX

Education

Bachelor's degree

Master's degree welcomed

Job description

Evaluate AI-generated work across audio, design, and UX by creating expert scenarios, reference answers, rubrics, and feedback. This remote contract pays $135 per hour and requires 20+ hours weekly.

Remote Hourly · $135/hr

$135/hr

Compensation

Contract, part-time

Engagement

Remote

Location

Posted

Open in 95 countries

Australia + more

• Albania


• Algeria


• Antigua and Barbuda


• Armenia


• Australia


• Austria


• Bahamas


• Bahrain


• Belgium


• Benin


• Bhutan


• Bosnia and Herzegovina


• Botswana


• Brunei


• Bulgaria


• Canada


• Costa Rica


• Côte d'Ivoire


• Croatia


• Cyprus


• Czechia


• Denmark


• Ecuador


• El Salvador


• Estonia


• Ethiopia


• Finland


• France


• Gambia


• Germany


• Greece


• Guatemala


• Guyana


• Hong Kong


• Hungary


• Iceland


• India


• Indonesia


• Ireland


• Israel


• Italy


• Jamaica


• Jordan


• Kenya


• Kuwait


• Latvia


• Liechtenstein


• Lithuania


• Luxembourg


• Madagascar


• Malaysia


• Malta


• Mauritius


• Mexico


• Moldova


• Mongolia


• Morocco


• Mozambique


• Namibia


• Netherlands


• New Zealand


• North Macedonia


• Norway


• Oman


• Pakistan


• Panama


• Peru


• Philippines


• Poland


• Portugal


• Qatar


• Romania


• Rwanda


• Saint Lucia


• Senegal


• Serbia


• Singapore


• Slovakia


• Slovenia


• South Africa


• Spain


• Sri Lanka


• Sweden


• Switzerland


• Taiwan


• Tanzania


• Thailand


• Trinidad and Tobago


• Tunisia


• Türkiye


• United Arab Emirates


• United Kingdom


• United States


• Uzbekistan


• Vietnam

The work

You will help evaluate AI systems across audio, design, and user experience. The work focuses on expert judgment and clear standards, not production engineering.

The duties and qualifications focus on AI evaluation across audio, design, and UX. Review them before applying to make sure the role matches your background.

• Design realistic technical scenarios and problem sets in your area of creative technology expertise.


• Write expert reference answers that show strong professional judgment.


• Create grading rubrics that separate correct, excellent, and deficient responses.


• Evaluate AI-generated outputs for correctness, depth, and practical domain judgment.


• Write clear technical explanations and structured feedback about evaluation standards.

What it pays and takes

This is a remote, part-time contract role.

• Pay: $135 per hour.


• Time requirement: 20+ hours per week.


• Work arrangement: Remote, independent, and asynchronous.


• Location: Open to candidates in listed countries, including the United States, Canada, Australia, India, Singapore, and the United Kingdom.


• Experience: Six to ten years in creative technology, media, audio, design, UX, or a closely related area.


• Professional background: Current or recent hands-on work, rather than a purely academic background.


• Education: Bachelor's degree required; master's degree welcomed.


• Communication: Strong writing skills for technical explanations, reference answers, rubrics, and structured feedback.


• Helpful experience: Reviewing or grading technical work, peer review, code review, grading, or editing.


• Additional signals: Research publications, open-source contributions, recognized work products, audio engineering, linguistics, or multimodal design experience.

About AI training work

AI training work uses human-created examples, reviews, and feedback to help artificial intelligence produce better results. People with strong professional judgment are paid to define quality, assess model outputs, and explain what good work looks like.