Veterans Benefits AI Evaluation Specialist

OpenTrain AI, Inc.; Northern (KY); Hybrid; USD 55,000 - 83,000; Part time

Job summary

OpenTrain AI, Inc. is seeking a remote, short-term contractor to improve AI-driven VA benefits guidance. You will review questions, write scoring rubrics for disability compensation, and define guidance on dependents, survivor benefits, appeals, and reviews. Strong VA accreditation and claims experience are required.

The role is part-time, 20–30 hours per week, based in the United States, with pay of $40–$60 per hour. Fluent English and precise writing are essential for success.

Qualifications

• Current VA accreditation as a VSO representative, County Veterans Service Officer, accredited claims agent, attorney, or similar qualification.
• At least one year preparing and filing VA claims for veterans or family members.
• Knowledge of disability compensation, dependents and survivor benefits, appeals and decision reviews.

Responsibilities

• Review sample questions about veterans benefits and identify questions that do not reflect realistic concerns.
• Write evaluation rubrics for service-connected disability compensation, including claim filing and evidence needed.
• Define accurate guidance about dependents and survivor benefits, including DIC and CHAMPVA.
• Create guidance covering appeals and decision reviews.
• Evaluate AI-generated answers against rubrics and flag errors, missing information, and outdated guidance.
• Share clear, precise written feedback with the project team.

Skills

English fluency

Clear writing

Attention to detail

Education

VA accreditation

Job description

The Work

You will help improve AI systems that answer questions about veterans benefits. You will use your professional claims experience to judge whether questions reflect realistic concerns and whether AI answers are accurate, complete, and current.

• Review sample questions about veterans benefits and identify questions that do not reflect realistic concerns from veterans or family members.
• Write evaluation rubrics for service-connected disability compensation, including claim filing and the evidence needed to support a claim.
• Define accurate guidance about dependents and survivor benefits, including DIC and CHAMPVA.
• Create guidance covering appeals and decision reviews.
• Evaluate AI-generated answers against your rubrics and flag errors, missing information, and outdated guidance.
• Share clear, precise written feedback asynchronously with the project team.

What It Pays And Takes

This is a remote, short-term contractor project for candidates based in the United States. The role is part time and requires a substantial weekly commitment.

• Pay: $40 to $60 per hour.
• Schedule: 20 to 30 hours per week.
• Location: Open to candidates based in the United States.
• Language: Fluent in English.
• Required accreditation: Current VA accreditation as a VSO representative, County Veterans Service Officer, accredited claims agent, attorney, or a similar professional qualification.
• Experience: At least one year preparing and filing VA claims for veterans or their families.
• Knowledge: Disability compensation, dependents and survivor benefits, appeals, and decision reviews.
• Skills: Clear, precise writing and the ability to distinguish complete, useful guidance from inaccurate or incomplete answers.
• Helpful background: Experience with military records such as the DD-214, creating guides or training materials, or supporting diverse veterans and families, including rural and non-English-speaking clients.

About AI Training Work

AI training is the human work behind systems that answer questions and generate content. Contributors review examples, write guidance, and rate model responses so AI systems become more accurate and useful; OpenTrain is where people find these projects, build a profile, and apply.