Marketing Media Content AI Evaluation Specialist

OpenTrain AI, Inc.; United States; Remote; USD 28,000 - 55,000; Part time

Job summary

OpenTrain AI, Inc. seeks a Marketing Media Content AI Evaluation Specialist for a 12-week contract. The role is remote and part-time, with 20–40 hours weekly, and requires fluent English.

You will design tasks, create scenarios, and develop scoring rubrics to assess AI outputs across market research, media production, and editorial communications. Strong writing and attention to detail are essential.

Qualifications

• Experience in market research and analytics, media production and direction, or editorial and technical communications.
• Three to 15 or more years of relevant industry experience, depending on your background.
• Strong written communication and documentation skills.
• Ability to explain critiques objectively and support decisions with clear reasoning.
• Careful attention to detail when reviewing logic, formatting, terminology, and rubric requirements.
• A bachelor's degree or equivalent practical experience in any field.
• Experience with AI evaluation, data annotation, content review, quality assurance, or analytical work is helpful but not required.

Responsibilities

• Design challenging tasks for your professional discipline.
• Create realistic workplace scenarios and gold-standard solution sets.
• Build and apply rubrics for accuracy, terminology, and overall quality.
• Score AI outputs and explain editorial, methodological, or artistic critiques.
• Identify logical inconsistencies, formatting errors, and deviations from the rubric.
• Improve deliverables through feedback and repeated critique cycles.

Skills

Market research

Analytics

Editorial writing

Attention to detail

Strong writing

Critical thinking

Education

Bachelor's degree or equivalent

Job description

Marketing Media Content AI Evaluation Specialist

Create workplace scenarios, answer sets, and scoring rubrics for AI evaluation across marketing, media, and editorial work. This 12-week contractor role offers flexible availability from 20 hours per week, with English fluency required.

100% Remote

Contract, part-time

Engagement

Remote

Location

Oct 27, 2026

Posted

The work

You will create and assess AI training tasks across market research and analytics, media production and direction, and editorial and technical communications. The work uses your professional judgment to decide whether AI outputs are accurate, clear, consistent, and fit for the task.

You will work through structured calibration and review cycles. Senior contributors may review peer work, resolve unclear cases, and identify differences between scoring rubrics.

• Design challenging tasks for your professional discipline.
• Create realistic workplace scenarios and gold-standard solution sets.
• Build and apply rubrics for accuracy, terminology, and overall quality.
• Score AI outputs and explain editorial, methodological, or artistic critiques.
• Identify logical inconsistencies, formatting errors, and deviations from the rubric.
• Improve deliverables through feedback and repeated critique cycles.

What it takes

This role is marked as entry level. The work also calls for demonstrable industry experience in at least one relevant area and the ability to make careful, consistent judgments during structured reviews.

• Experience in market research and analytics, media production and direction, or editorial and technical communications.


• Three to 15 or more years of relevant industry experience, depending on your background.


• Strong written communication and documentation skills.


• Ability to explain critiques objectively and support decisions with clear reasoning.


• Careful attention to detail when reviewing logic, formatting, terminology, and rubric requirements.


• A bachelor's degree or equivalent practical experience in any field.


• Experience with AI evaluation, data annotation, content review, quality assurance, or analytical work is helpful but not required.

Schedule and engagement

This is a 12-week contractor engagement. The schedule is part time or full time within the stated availability range, with required overlap during Pacific Time.

• Availability of at least 4 hours per day and up to 40 hours per week.


• At least 20 hours per week.


• Four hours of overlap with Pacific Time.

About AI training work

AI training work is the human side of building artificial intelligence. Contributors create examples, review model responses, and apply expert standards so AI systems produce more accurate and useful results.

Requirements

• Experience: Entry level

Compensation

This remote contractor project pays $20 per hour for 20 to 40 hours per week.

Pay is $60 to $120 per hour equivalent, paid per task.