Remote AI Prompt Evaluator & Quality Assurance Specialist

Crossing Hurdles; United States; Remote; USD 48,216 - 55,104; Part time

Job summary

A leading evaluation organization seeks a Generalist Evaluator Expert for a remote, flexible contract role. This position involves designing prompts for language model evaluations, defining standards, and conducting assessments. Ideal candidates should have strong writing and critical thinking skills, familiarity with AI tools like ChatGPT, and a BS or BA degree. This mid-senior level role offers flexible hours (10-40/week) and competitive compensation of $35-$40/hour.

Qualifications

• Strong writing skills and critical thinking necessary for prompt design.
• Ability to work independently while meeting deadlines.
• Significant familiarity with language tools like ChatGPT.

Responsibilities

• Design and optimize detailed prompts for AI model evaluations.
• Define evaluation standards and develop comprehensive rubrics.
• Conduct testing and grading of AI model outputs.

Skills

Strong writing skills

Critical thinking

Instructional clarity

Familiarity with ChatGPT

Ability to work independently

Education

BS or BA degree from a reputable institution

Job description

A leading evaluation organization seeks a Generalist Evaluator Expert for a remote, flexible contract role. This position involves designing prompts for language model evaluations, defining standards, and conducting assessments. Ideal candidates should have strong writing and critical thinking skills, familiarity with AI tools like ChatGPT, and a BS or BA degree. This mid-senior level role offers flexible hours (10-40/week) and competitive compensation of $35-$40/hour.