GenAI Retail Evaluator for LLM Training

DigiNo; Northern (KY); Hybrid; USD 140,000 - 190,000; Full time

Job summary

Cincinnatus LLC is seeking a seasoned Retail SME to join its GenAI initiative and help evaluate AI model outputs against real-world retail rubrics. You will support research and engineering teams to bring retail judgment to AI training data and ensure high-quality evaluations.

Ideal candidates have 8+ years in retail, proven ability to work 35 hours weekly, and strong communication and problem-solving skills. This is a W-2 engagement with potential placement at a leading AI Lab.

Qualifications

• 8+ years of professional experience in retail (merchandising, category management, operations, buying/planning) at top-tier organizations.
• Hands-on experience evaluating LLM/AI model outputs against rubrics or structured scoring criteria.
• Demonstrable career progression (e.g., Category Manager, Senior Manager, Director).

Responsibilities

• Guide research and engineering teams to close knowledge gaps in retail merchandising, category management, and operations reasoning.
• Design challenging retail tasks and write accurate, well-reasoned solutions grounded in real retail practice.
• Evaluate AI model outputs against rubrics and provide clear, written feedback on correctness, judgment, and reasoning quality.
• Develop and refine evaluation guidelines and scoring rubrics specific to retail tasks.
• Collaborate with other SMEs to ensure consistency and accuracy in training data.

Skills

Retail experience

AI model evaluation

Career progression

Written communication

Job description

Cincinnatus LLC is seeking a seasoned Retail SME to join its GenAI initiative and help evaluate AI model outputs against real-world retail rubrics. You will support research and engineering teams to bring retail judgment to AI training data and ensure high-quality evaluations.

Ideal candidates have 8+ years in retail, proven ability to work 35 hours weekly, and strong communication and problem-solving skills. This is a W-2 engagement with potential placement at a leading AI Lab.