AI Rater Guidelines Architect (Contractor)

OpenTrain AI; Northern (KY); Hybrid; USD 62,000 - 90,000; Part time

Job summary

OpenTrain AI is seeking an AI Rater Guidelines Writer in the United States to translate high-level program specifications into precise, unambiguous rater guidelines. You will bridge requirements to field application by creating clear, non-contradictory instructions that support consistent decisions across domains.

This part-time contractor role focuses on developing, refining, and finalizing guidelines for field use, adapting terminology across finance, retail, insurance, legal, and sports

Qualifications

• Requires professional experience developing clear written guidance and direct experience supporting human rating in a GenAI or RLHF environment.
• Ability to work across multiple subject-matter domains and translate domain-specific nuance into clear instructions.
• Strong written communication skills, including the ability to explain complex guidance clearly.

Responsibilities

• Translate high-level program specifications into precise, unambiguous rater guidelines.
• Design rating rubrics that raters can apply consistently, including for edge cases.
• Review draft guidelines for internal contradictions and coverage gaps.
• Revise guidelines until they are ready for field application.
• Collaborate with subject-matter experts and program leads to maintain consistency and accuracy across the full guideline set.

Skills

Linguistics

Instructional design

Technical writing

GenAI/RLHF experience

Job description

OpenTrain AI is seeking an AI Rater Guidelines Writer in the United States to translate high-level program specifications into precise, unambiguous rater guidelines. You will bridge requirements to field application by creating clear, non-contradictory instructions that support consistent decisions across domains.

This part-time contractor role focuses on developing, refining, and finalizing guidelines for field use, adapting terminology across finance, retail, insurance, legal, and sports