Public Benefits AI Evaluator — Remote, Part-Time

OpenTrain AI, Inc.

United States

Remote

USD 41,000 - 55,000

Part time

6 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

OpenTrain AI, Inc. seeks an experienced 211 Specialist to evaluate AI answers for government services. This part-time, remote role focuses on reviewing questions, writing rubrics, and giving precise feedback to improve accuracy and usefulness.

You will assess AI responses for realism, completeness, and currency, and work asynchronously with flexible hours from United States residents. Prior 211 or benefits navigator background is preferred.

Qualifications

  • Experience as 211 Specialist, Information and Referral Specialist, or Benefits Navigator.
  • Ability to judge whether questions reflect realistic caller needs.
  • Ability to write clear feedback based on public-service accuracy.
  • Experience with evaluating AI-generated content is a plus.

Responsibilities

  • Review sample questions and identify unrealistic requests.
  • Write rubrics that define correct answers, referrals, and next steps.
  • Evaluate AI-generated answers against rubrics for accuracy and usefulness.
  • Identify errors, missing information, outdated guidance, and unhelpful responses.
  • Provide precise written feedback based on public-service accuracy.

Skills

Clear, precise writing
Public benefits knowledge
Evaluation of AI responses
Rubric development

Job description

OpenTrain AI, Inc. seeks an experienced 211 Specialist to evaluate AI answers for government services. This part-time, remote role focuses on reviewing questions, writing rubrics, and giving precise feedback to improve accuracy and usefulness.

You will assess AI responses for realism, completeness, and currency, and work asynchronously with flexible hours from United States residents. Prior 211 or benefits navigator background is preferred.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote 211 Specialist - Public Services Evaluator
Remote 211 Specialist - Public Services Evaluator

Aitrainergigs • United States

Remote
USD 28,000 - 50,000
Remote 211 Specialist — Part-Time Guidance Evaluator
Remote 211 Specialist — Part-Time Guidance Evaluator

YO AI Labs • New York (NY)

Remote
USD 30,000 - 47,000
Remote work
Flexible hours
Short-term project
AI Public Services Evaluator — 211 Specialist
AI Public Services Evaluator — 211 Specialist

Remolity, Inc. • United States

Remote
USD 20,000 - 30,000
211 Specialist, Government Services AI Evaluator
211 Specialist, Government Services AI Evaluator

OpenTrain AI, Inc. • United States

Remote
USD 41,000 - 55,000
Government & Social AI Prompts Evaluator (Remote)
Government & Social AI Prompts Evaluator (Remote)

OpenTrain AI, Inc. • United States

Remote
USD 136,000 - 194,000
211 Specialist
211 Specialist

confidential • United States

Remote
USD 28,000 - 50,000
Public Benefits AI QA & Information Specialist
Public Benefits AI QA & Information Specialist

Crossing Hurdles • United States

On-site
USD 55,000 - 75,000
Remote 211 Specialist - Shape Accurate Public Guidance
Remote 211 Specialist - Shape Accurate Public Guidance

Remotebridge • United States

Remote
USD 34,000 - 55,000
Crisis intervention
Community resources databases
Guides and training materials
211 Specialist - Remote
211 Specialist - Remote

YO AI Labs • New York (NY)

Remote
USD 30,000 - 47,000
Remote work
Flexible hours
Short-term project
Remote Public Services AI Clarity Reviewer
Remote Public Services AI Clarity Reviewer

OpenTrain AI, Inc. • United States

Hybrid
USD 28,000 - 41,000