Remote AI Evaluation Specialist — Marketing & Media Content

OpenTrain AI, Inc.; United States; Remote; USD 28,000 - 55,000; Part time

Job summary

OpenTrain AI, Inc. seeks a Marketing Media Content AI Evaluation Specialist for a 12-week contract. The role is remote and part-time, with 20–40 hours weekly, and requires fluent English.

You will design tasks, create scenarios, and develop scoring rubrics to assess AI outputs across market research, media production, and editorial communications. Strong writing and attention to detail are essential.

Qualifications

• Experience in market research and analytics, media production and direction, or editorial and technical communications.
• Three to 15 or more years of relevant industry experience, depending on your background.
• Strong written communication and documentation skills.
• Ability to explain critiques objectively and support decisions with clear reasoning.
• Careful attention to detail when reviewing logic, formatting, terminology, and rubric requirements.
• A bachelor's degree or equivalent practical experience in any field.
• Experience with AI evaluation, data annotation, content review, quality assurance, or analytical work is helpful but not required.

Responsibilities

• Design challenging tasks for your professional discipline.
• Create realistic workplace scenarios and gold-standard solution sets.
• Build and apply rubrics for accuracy, terminology, and overall quality.
• Score AI outputs and explain editorial, methodological, or artistic critiques.
• Identify logical inconsistencies, formatting errors, and deviations from the rubric.
• Improve deliverables through feedback and repeated critique cycles.

Skills

Market research

Analytics

Editorial writing

Attention to detail

Strong writing

Critical thinking

Education

Bachelor's degree or equivalent

Job description

OpenTrain AI, Inc. seeks a Marketing Media Content AI Evaluation Specialist for a 12-week contract. The role is remote and part-time, with 20–40 hours weekly, and requires fluent English.

You will design tasks, create scenarios, and develop scoring rubrics to assess AI outputs across market research, media production, and editorial communications. Strong writing and attention to detail are essential.