Remote AI Prompt Evaluator & Quality Assurance Specialist

Crossing Hurdles

United States

Remote

USD 48,216 - 55,104

Part time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

A leading evaluation organization seeks a Generalist Evaluator Expert for a remote, flexible contract role. This position involves designing prompts for language model evaluations, defining standards, and conducting assessments. Ideal candidates should have strong writing and critical thinking skills, familiarity with AI tools like ChatGPT, and a BS or BA degree. This mid-senior level role offers flexible hours (10-40/week) and competitive compensation of $35-$40/hour.

Qualifications

  • Strong writing skills and critical thinking necessary for prompt design.
  • Ability to work independently while meeting deadlines.
  • Significant familiarity with language tools like ChatGPT.

Responsibilities

  • Design and optimize detailed prompts for AI model evaluations.
  • Define evaluation standards and develop comprehensive rubrics.
  • Conduct testing and grading of AI model outputs.

Skills

Strong writing skills
Critical thinking
Instructional clarity
Familiarity with ChatGPT
Ability to work independently

Education

BS or BA degree from a reputable institution

Job description

A leading evaluation organization seeks a Generalist Evaluator Expert for a remote, flexible contract role. This position involves designing prompts for language model evaluations, defining standards, and conducting assessments. Ideal candidates should have strong writing and critical thinking skills, familiarity with AI tools like ChatGPT, and a BS or BA degree. This mid-senior level role offers flexible hours (10-40/week) and competitive compensation of $35-$40/hour.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Generative AI Quality Evaluator (Remote)
Generative AI Quality Evaluator (Remote)

Crossing Hurdles • United States

Remote
CAD 27,552 - 41,328
Remote AI Personalization & Evaluation Specialist
Remote AI Personalization & Evaluation Specialist

Crossing Hurdles • United States

Remote
USD 60,000 - 80,000
Remote English AI Quality Evaluator
Remote English AI Quality Evaluator

Anyone AI • United States

Remote
USD 9,600 - 17,000
AI Evaluation & Prompt Specialist - Remote, Part-Time
AI Evaluation & Prompt Specialist - Remote, Part-Time

Crossing Hurdles • United States

Remote
USD 28,000 - 48,000
Remote AI Output Evaluator: Personalization & Quality
Remote AI Output Evaluator: Personalization & Quality

Crossing Hurdles • United States

Remote
USD 60,000 - 80,000
Remote AI Evaluation Specialist - Fluent English
Remote AI Evaluation Specialist - Fluent English

Crossing Hurdles • United States

Remote
USD 28,000 - 55,000
Remote AI Agent Evaluator QA Strategist
Remote AI Agent Evaluator QA Strategist

Mindrift • Wisconsin

Remote
USD 68,191 - 97,120
Competitive pay up to $60/hour
Flexible remote work
Opportunity to work on advanced AI projects
AI Response Evaluator & Feedback Specialist
AI Response Evaluator & Feedback Specialist

Crossing Hurdles • United States

Remote
USD 52,000 - 93,000
AI Response Quality Analyst (Remote, Part-Time)
AI Response Quality Analyst (Remote, Part-Time)

Anyone AI Inc. • United States

Remote
CLP 9,510,000 - 16,303,000
Remote AI Evaluation Specialist
Remote AI Evaluation Specialist

Anyone AI Inc. • United States

Remote
USD 28,000 - 48,000