Remote Medicare AI Evaluator & Counselor Rubric Architect

OpenTrain AI, Inc.; Northern (KY); Hybrid; USD 41,000 - 83,000; Part time

Job summary

OpenTrain AI, Inc. seeks a remote contractor to help improve AI systems answering Medicare questions. You will review questions for real beneficiary relevance and assess the accuracy, usefulness, and currency of generated answers.

The role emphasizes Medicare counseling expertise, precise written feedback, and rubrics for enrollment topics. Experience with SHIP certification or SSA Medicare enrollment is valued, with 20–30 hours weekly on a short-term project.

Qualifications

• Active or recent SHIP certification, or SSA Medicare enrollment experience.
• At least one year advising on initial enrollment, special enrollment periods, Part B late penalties, Medigap versus Medicare Advantage, and Part D.
• Clear, precise written communication and the ability to contribute consistently to a short-term project.

Responsibilities

• Review sample Medicare questions and identify questions that do not reflect real beneficiary concerns.
• Create rubrics for initial enrollment, special enrollment periods, and Part B late penalties.
• Define guidance for comparing Medigap, Medicare Advantage, and Part D plans, including key differences and suitable use cases.
• Evaluate AI-generated answers and flag errors, missing information, and outdated guidance.
• Provide precise written feedback on model responses.

Skills

Medicare counseling

Written communication

English fluency

Job description

OpenTrain AI, Inc. seeks a remote contractor to help improve AI systems answering Medicare questions. You will review questions for real beneficiary relevance and assess the accuracy, usefulness, and currency of generated answers.

The role emphasizes Medicare counseling expertise, precise written feedback, and rubrics for enrollment topics. Experience with SHIP certification or SSA Medicare enrollment is valued, with 20–30 hours weekly on a short-term project.