Remote Retail AI Evaluation Specialist

Weekday AI; United States; À distance; USD 83 000 - 110 000; Plein temps

Résumé du poste

Weekday AI seeks a highly experienced Retail Specialist to contribute real-world retail judgment to AI training data. You will design realistic tasks, evaluate AI outputs against rubrics, and provide structured feedback to improve models.

This full-time, fully remote role requires 8+ years of retail experience and the ability to commit ~35 hours per week on weekdays. Ideal candidates bring expertise in merchandising, category management, and retail operations, with a track record of working in

Qualifications

• 8+ years of professional retail experience in merchandising, category management, buying, retail planning, retail operations, or related functions.
• Experience within a large-scale retail, consumer, e-commerce, or omnichannel organization is strongly preferred.
• Prior hands-on experience evaluating LLM or AI-generated outputs against rubrics or structured scoring criteria is mandatory.
• Career progression to roles such as Category Manager, Senior Manager, or Director of Merchandising.
• Strong understanding of retail strategy, merchandising processes, category performance, inventory considerations, customer behavior, and operational decision-making.
• Excellent written and verbal communication skills, with ability to explain professional judgment and reasoning.
• Ability to commit to approximately 35 hours per week during weekdays.

Responsabilités

• Identify knowledge gaps related to retail merchandising, category management, buying, planning, and operations.
• Design challenging, realistic retail tasks reflecting real-world business scenarios and decision-making.
• Develop accurate, well-reasoned solutions based on established retail practices and professional experience.
• Evaluate AI-generated responses using structured rubrics, assessing accuracy, reasoning, judgment, relevance, and completeness.
• Provide clear and actionable written feedback explaining strengths, weaknesses, and areas for improvement.
• Develop and refine evaluation guidelines and scoring frameworks for retail-related tasks.
• Collaborate with subject-matter experts to maintain consistency, accuracy, and quality across AI training datasets.
• Translate practical retail knowledge into structured guidance to improve AI systems.

Connaissances

Retail expertise

Analytical thinking

Communication skills

Description du poste

Weekday AI seeks a highly experienced Retail Specialist to contribute real-world retail judgment to AI training data. You will design realistic tasks, evaluate AI outputs against rubrics, and provide structured feedback to improve models.

This full-time, fully remote role requires 8+ years of retail experience and the ability to commit ~35 hours per week on weekdays. Ideal candidates bring expertise in merchandising, category management, and retail operations, with a track record of working in