GenAI Rater Guidelines Architect

Mercor; United States; On-site; USD 90,000 - 120,000; Full time

Job summary

Join a leading AI lab's GenAI team and help build foundational AI models from the ground up. We seek linguists and instructional designers who translate vague requirements into precise, ratable instructions across finance, retail, insurance, legal, and sports.

This is a W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading AI Lab as part of their extended workforce.

Qualifications

• 3+ years of professional experience in linguistics, instructional design, technical writing, or a closely related field.
• Experience writing or refining guidelines and rubrics for human raters in GenAI/RLHF contexts.
• Ability to work across multiple domains (finance, retail, insurance, legal, sports) and translate nuances into clear instructions.
• Proven ability to resolve ambiguity and contradictions in written specifications with concrete before/after examples.
• Demonstrated career progression.
• Able to commit to at least 35 hours per week on weekdays.

Responsibilities

• Guide research and program teams to close the gap between ambiguous requirements and rater-ready instructions across a range of subject‑matter domains.
• Design clear, non‑contradictory rating guidelines and rubrics that raters can apply consistently, including under edge cases.
• Evaluate draft guidelines for ambiguity, internal contradiction, and coverage gaps, and revise until raters can apply them without escalation.
• Translate program specifications from domains such as finance, retail, insurance, legal, and sports into precise, discipline‑specific rater instructions.
• Collaborate with other subject matter experts and program leads to ensure consistency and accuracy across guideline sets.

Skills

Linguistics

Instructional Design

Technical Writing

Job description

Join a leading AI lab's GenAI team and help build foundational AI models from the ground up. We seek linguists and instructional designers who translate vague requirements into precise, ratable instructions across finance, retail, insurance, legal, and sports.

This is a W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading AI Lab as part of their extended workforce.