AI Rater Guidelines Writer (Linguist / Instructional Designer)

HumanitApp; Northern (KY); Hybrid; USD 62,000 - 90,000; Full time

Job summary

Cincinnatus LLC is seeking a Linguist / Instructional Designer to join a GenAI evaluation team. You will translate ambiguous program requirements into clear, unambiguous rater guidelines and collaborate with domain experts across finance, retail, insurance, legal, and sports.

This W-2 role is with Cincinnatus LLC and placed at a leading AI Lab as part of the extended workforce. Strong written communication and ability to produce precise instructions are essential, with a 35+ hour weekday

Qualifications

• 3+ years of professional experience in linguistics, instructional design, technical writing, or a closely related field, with direct experience writing or refining guidelines/rubrics for human raters in a GenAI/RLHF context.

Responsibilities

• Guide research and program teams to close the gap between ambiguous program requirements and rater-ready instructions across a range of subject-matter domains.
• Design clear, non-contradictory rating guidelines and rubrics that raters can apply consistently, including under edge cases.
• Evaluate draft guidelines for ambiguity, internal contradiction, and coverage gaps, and revise until raters can apply them without escalation.
• Translate program specifications from domains such as finance, retail, insurance, legal, and sports into precise, discipline-specific rater instructions.
• Collaborate with other subject matter experts and program leads to ensure consistency and accuracy across guideline sets.

Skills

Linguistics

Instructional design

Technical writing

Job description

Overview

Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced Large Language Models.

Join a leading AI lab's cutting-edge GenAI team and help build foundational AI models from the ground up. We're seeking talented Linguists and Instructional Designers with deep experience translating ambiguous program requirements into clear, unambiguous rater guidelines to bring precision and consistency to our AI training data

working across domains from finance and retail to insurance, legal, and sports.

This is a W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading AI Lab as part of their extended workforce.

Key Responsibilities

• Guide research and program teams to close the gap between ambiguous program requirements and rater-ready instructions across a range of subject-matter domains.
• Design clear, non-contradictory rating guidelines and rubrics that raters can apply consistently, including under edge cases.
• Evaluate draft guidelines for ambiguity, internal contradiction, and coverage gaps, and revise until raters can apply them without escalation.
• Translate program specifications from domains such as finance, retail, insurance, legal, and sports into precise, discipline-specific rater instructions.
• Collaborate with other subject matter experts and program leads to ensure consistency and accuracy across guideline sets.

Core Qualifications

• 3+ years of professional experience in linguistics, instructional design, technical writing, or a closely related field, with direct experience writing or refining guidelines/rubrics for human raters in a GenAI/RLHF context.
• Demonstrated ability to work across multiple subject-matter domains (e.g., finance, retail, insurance, legal, sports) and translate domain-specific nuance into clear, unambiguous instructions.
• Strong track record of resolving ambiguity and contradiction in written specifications able to point to concrete before/after examples.
• Demonstrable career progression.
• Ability to engage reliably for at least 35 hours/week during weekdays.
• Strong written communication skills and the ability to explain complex or nuanced guidance clearly and precisely.

About Cincinnatus LLC: Cincinnatus LLC is an enterprise staffing company that partners with leading technology companies to source and employ highly skilled professionals for contingent and contract-based opportunities. Cincinnatus serves as the employer of record for these engagements, providing W-2 employment, payroll, benefits, and compliance, while placing employees directly within client teams to work on high-impact initiatives.

Equal Employment Opportunity: Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic.

AI evaluation Clinical reasoning Finance Research Technical writing

Who this role may fit

This opportunity may suit professionals with relevant experience in AI evaluation, Clinical reasoning, Finance, Research. Review the official description and requirements before applying.

Compensation

The listing states $45 - $65 / hour. Confirm the final rate, workload, and payment terms during the official application process.

• You can show recent, specific work involving AI evaluation, Clinical reasoning, Finance.
• The listed commitment of 35 hours/week fits your schedule.
• You can communicate your reasoning clearly in the application language.
• You are comfortable with project availability and hours varying over time.