Remote AI Evaluation Specialist - Fluent English

Crossing Hurdles

United States

Remote

USD 28,000 - 55,000

Part time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Crossing Hurdles is seeking an English Speaking Generalist for remote contract work. You will craft prompts, run side-by-side evaluations using ChatGPT and Claude, and provide thorough verbal feedback in American English.

The role emphasizes consistent evaluation standards and collaboration with AI model improvement efforts. Ideal candidates have strong English communication, experience with large language models, and a reliable technical setup for recording sessions.

Qualifications

  • High-level fluency in spoken and written American English with clear pronunciation.
  • Experience using large language models such as ChatGPT, Claude, or similar platforms.
  • Familiarity with AI evaluation tasks and criteria.
  • Comfortable recording screen and audio for evaluation sessions.
  • Background in data annotation, AI training, quality assurance, content evaluation, or research is advantageous.

Responsibilities

  • Create diverse prompts across topics to challenge large language models.
  • Submit identical prompts to ChatGPT and Claude, recording screen and microphone.
  • Articulate comparisons and evaluate outputs from both models in real time.
  • Provide detailed verbal feedback in clear American English, explaining reasoning and preferences.
  • Interpret documentation to ensure consistent evaluation standards and accurate project delivery.
  • Collaborate with project guidelines to support continuous improvement of AI models.

Skills

Fluent English
LLM Experience
AI Evaluation
Screen/Voice Recording
Data Annotation/QA
Technical Setup

Tools

ChatGPT
Claude

Job description

Crossing Hurdles is seeking an English Speaking Generalist for remote contract work. You will craft prompts, run side-by-side evaluations using ChatGPT and Claude, and provide thorough verbal feedback in American English.

The role emphasizes consistent evaluation standards and collaboration with AI model improvement efforts. Ideal candidates have strong English communication, experience with large language models, and a reliable technical setup for recording sessions.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Evaluation & Prompt Specialist - Remote, Part-Time
AI Evaluation & Prompt Specialist - Remote, Part-Time

Crossing Hurdles • United States

Remote
USD 28,000 - 48,000
English Speaker | $30/hr Remote
English Speaker | $30/hr Remote

Crossing Hurdles • United States

Remote
USD 28,000 - 55,000
Language Specialist | $30/Hr Remote
Language Specialist | $30/Hr Remote

Crossing Hurdles • United States

Remote
USD 28,000 - 48,000
English Speaking Generalist
English Speaking Generalist

Executive Staff Recruiters / ESR Healthcare • United States

Remote
USD 60,000 - 90,000
Remote AI Evaluation Specialist (English)
Remote AI Evaluation Specialist (English)

Executive Staff Recruiters / ESR Healthcare • United States

Remote
USD 60,000 - 90,000
Remote AI Evaluation Analyst — Fluent English
Remote AI Evaluation Analyst — Fluent English

Outlier • Baton Rouge (LA)

Remote
USD 17,000 - 25,000
Remote work
Free access to leading LLMs
Weekly payments
Remote AI Evaluation Specialist — English Speaker
Remote AI Evaluation Specialist — English Speaker

Outlier • Missoula (MT)

Hybrid
USD 20,000 - 29,000
Fully remote
Flexible hours
Weekly payments
+1
Remote AI Prompt Evaluator & Quality Assurance Specialist
Remote AI Prompt Evaluator & Quality Assurance Specialist

Crossing Hurdles • United States

Remote
USD 48,216 - 55,104
Remote AI Training & Evaluation Specialist
Remote AI Training & Evaluation Specialist

Crossing Hurdles • United States

Remote
USD 28,000 - 40,000
Remote Generative AI Evaluator & Feedback Specialist
Remote Generative AI Evaluator & Feedback Specialist

Crossing Hurdles • United States

Remote
USD 28,000 - 40,000