211 Specialist, Government Services AI Evaluator

OpenTrain AI, Inc.; United States; Remote; USD 41,000 - 55,000; Part time

Job summary

OpenTrain AI, Inc. seeks an experienced 211 Specialist to evaluate AI answers for government services. This part-time, remote role focuses on reviewing questions, writing rubrics, and giving precise feedback to improve accuracy and usefulness.

You will assess AI responses for realism, completeness, and currency, and work asynchronously with flexible hours from United States residents. Prior 211 or benefits navigator background is preferred.

Qualifications

• Experience as 211 Specialist, Information and Referral Specialist, or Benefits Navigator.
• Ability to judge whether questions reflect realistic caller needs.
• Ability to write clear feedback based on public-service accuracy.
• Experience with evaluating AI-generated content is a plus.

Responsibilities

• Review sample questions and identify unrealistic requests.
• Write rubrics that define correct answers, referrals, and next steps.
• Evaluate AI-generated answers against rubrics for accuracy and usefulness.
• Identify errors, missing information, outdated guidance, and unhelpful responses.
• Provide precise written feedback based on public-service accuracy.

Skills

Clear, precise writing

Public benefits knowledge

Evaluation of AI responses

Rubric development

Job description

211 Specialist, Government Services AI Evaluator

Use your experience helping people find public benefits and community resources to evaluate AI answers, write scoring guides, and give precise feedback. This U.S.-based contract role pays $30 to $40 per hour.

Remote Hourly · $30–$40/hr

$30–$40/hr

Compensation

Contract, part-time

Engagement

Remote

Location

Oct 13, 2026

Posted

Open to applicants in

United States

The work

You will help improve AI systems that answer questions about government services and community resources. Your work will draw on your experience as a 211 Specialist, Information and Referral Specialist, or Benefits Navigator.

You will judge whether questions sound like real requests from people seeking help, then assess whether AI answers are accurate, complete, current, and useful. The work is done asynchronously and includes writing clear feedback.

• Review sample questions and identify requests that do not reflect realistic caller needs.
• Write rubrics that define correct answers, suitable referrals, and useful next steps.
• Evaluate AI-generated answers against those rubrics.
• Identify errors, missing information, outdated guidance, and unhelpful responses.
• Give precise written feedback based on public-service accuracy and caller usefulness.

What it pays and takes

This is a part-time contract role for someone with practical experience answering public questions about government services, benefits, and community resources.

• Pay: $30 to $40 per hour.
• Location: Open to candidates currently residing in the United States.
• Experience: At least one year of regular, high-volume public contact through phone, chat, or in-person service.
• Required background: Experience as a 211 Specialist, Information and Referral Specialist, or Benefits Navigator.
• Required knowledge: Working knowledge of public benefits and community resources.
• Required skills: Clear, precise writing and the ability to judge whether guidance is complete and actionable.
• Helpful experience: Crisis intervention, needs assessment, community resource databases, guides, scripts, or training materials.
• Helpful experience: Service to rural or Spanish-speaking communities.

About AI training work

AI training is the human work behind systems that answer questions and generate content. Experienced public-service professionals help by reviewing examples, setting standards, and showing AI how accurate, complete, and useful guidance should look.

Review Korean and English AI responses, annotate text, and compare long-form content to help improve AI systems. This part-time contract role suits fluent Korean and English speakers with strong attention to detail.

Review homework problems and AI responses across quantitative subjects, then give clear feedback on accuracy and reasoning. This remote, part-time contractor role pays $20 to $45 per hour.

Review lengthy Mandarin and English chat responses, compare quality, and evaluate programming discussions for AI training. This remote, part-time contractor role pays $20 to $45 per hour.

Review AI-generated videos, compare outputs, and explain which result is stronger using your editing judgment. This contractor role pays $20 to $40 per hour and values Premiere Pro and After Effects skills.

Review AI-generated environmental work on permitting, compliance, remediation, air and water modeling, and impact studies. This fully remote contractor role pays $100 per hour and offers flexible, asynchronous work.

Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more