Retail AI Evaluation Specialist

aitrainer; United States; On-site; USD 66,124 - 110,208; Full time

Job summary

aitrainer is seeking a Retail Specialist to support a GenAI training program in the United States. The role focuses on applying deep retail knowledge to design tasks and rigorously evaluate AI outputs against rubrics.

Ideal candidates have extensive retail experience and a proven track record evaluating model outputs, with the ability to commit to at least 35 hours per week of weekday work.

Qualifications

• 8+ years of dedicated retail experience at a top-tier organization.
• Hands-on evaluation of LLM/AI outputs against rubrics or scoring criteria required.
• Demonstrated career progression in merchandising or retail leadership.

Responsibilities

• Guide research and engineering teams to close retail knowledge gaps.
• Design domain-relevant retail tasks and write solutions grounded in practice.
• Evaluate AI outputs against rubrics and provide written feedback.
• Develop evaluation guidelines and scoring rubrics for retail tasks.
• Collaborate with SMEs to ensure data accuracy and consistency.

Skills

Retail experience

Model evaluation

Career progression

35 hours/week

Communication skills

Job description

aitrainer is seeking a Retail Specialist to support a GenAI training program in the United States. The role focuses on applying deep retail knowledge to design tasks and rigorously evaluate AI outputs against rubrics.

Ideal candidates have extensive retail experience and a proven track record evaluating model outputs, with the ability to commit to at least 35 hours per week of weekday work.