AI Evaluation & Prompt Specialist - Remote, Part-Time

Crossing Hurdles

United States

Remote

USD 28,000 - 48,000

Part time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Crossing Hurdles is seeking an English Speaking Generalist for remote contract work. You will design diverse prompts to test large language models, execute side-by-side prompts for ChatGPT and Claude, and provide clear verbal feedback in American English.

You will also interpret guidelines to ensure consistent evaluation and contribute to ongoing model improvement. The role requires strong English proficiency, familiarity with AI evaluation practices, and a reliable technical setup for screen

Qualifications

  • High-level fluency in spoken and written American English with clear pronunciation.
  • Experience using large language models such as ChatGPT, Claude, or similar platforms.
  • Familiarity with AI evaluation tasks.
  • Comfortable recording screen and audio for extended evaluation sessions.

Responsibilities

  • Create diverse prompts across various topics to challenge large language models.
  • Submit identical prompts to ChatGPT and Claude, recording screen and microphone.
  • Articulate comparisons and evaluate outputs from both models in real time.
  • Provide detailed verbal feedback in clear American English, explaining reasoning and preferences.
  • Interpret documentation to ensure consistent evaluation standards and accurate project delivery.
  • Collaborate with project guidelines to support continuous improvement of AI models.

Skills

English fluency
LLMs experience
AI evaluation
Screen/mic recording
Data annotation/QA/AI research
Technical setup

Tools

Screen recording tools

Job description

Crossing Hurdles is seeking an English Speaking Generalist for remote contract work. You will design diverse prompts to test large language models, execute side-by-side prompts for ChatGPT and Claude, and provide clear verbal feedback in American English.

You will also interpret guidelines to ensure consistent evaluation and contribute to ongoing model improvement. The role requires strong English proficiency, familiarity with AI evaluation practices, and a reliable technical setup for screen

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Evaluation Specialist - Fluent English
Remote AI Evaluation Specialist - Fluent English

Crossing Hurdles • United States

Remote
USD 28,000 - 55,000
English Speaker | $30/hr Remote
English Speaker | $30/hr Remote

Crossing Hurdles • United States

Remote
USD 28,000 - 55,000
Language Specialist | $30/Hr Remote
Language Specialist | $30/Hr Remote

Crossing Hurdles • United States

Remote
USD 28,000 - 48,000
English Speaking Generalist
English Speaking Generalist

Executive Staff Recruiters / ESR Healthcare • United States

Remote
USD 60,000 - 90,000
Remote AI Prompt Evaluator & Quality Assurance Specialist
Remote AI Prompt Evaluator & Quality Assurance Specialist

Crossing Hurdles • United States

Remote
USD 48,216 - 55,104
AI Content Evaluator: Prompt & Response Quality (Remote)
AI Content Evaluator: Prompt & Response Quality (Remote)

Crossing Hurdles • United States

Remote
USD 28,000 - 40,000
Remote AI Prompt & Response Evaluator
Remote AI Prompt & Response Evaluator

Crossing Hurdles • United States

Remote
USD 28,000 - 40,000
Remote Generative AI Evaluator & Feedback Specialist
Remote Generative AI Evaluator & Feedback Specialist

Crossing Hurdles • United States

Remote
USD 28,000 - 40,000
AI Prompt & Response Evaluator - Remote Short-Term
AI Prompt & Response Evaluator - Remote Short-Term

micro1 • United States

Remote
USD 62,000 - 96,000
Remote Educational AI Evaluator & Feedback Specialist
Remote Educational AI Evaluator & Feedback Specialist

Crossing Hurdles • United States

Remote
USD 28,000 - 40,000