AI Evaluator (E-Commerce) | $30/hr | Remote

Codefeast

United States

Remote

USD 34,000 - 49,000

Part time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Codefeast is seeking AI evaluators for a remote, contractor role evaluating a digital shopping assistant. You will review user interactions, identify errors and poor recommendations, and develop rubrics to assess response quality.

The position requires familiarity with data evaluation, QA, and AI training, and you must commit at least 20 hours per week. Ideal candidates have strong analytical skills and knowledge of e-commerce search, with a preference for candidates without H-1B/STEM OPT

Qualifications

  • Experience in data evaluation, QA, or AI training.
  • Strong analytical skills with attention to subtle errors.
  • Familiarity with e-commerce search and online shopping.
  • Available for at least 20 hours per week.
  • Candidates on H-1B or STEM OPT are not supported.

Responsibilities

  • Review user interaction records with the AI shopping assistant.
  • Identify inaccurate responses and unhelpful product recommendations.
  • Create rubrics and verifiers for evaluating response quality.
  • Commit to at least 20 hours per week on the project platform.

Skills

Data evaluation experience
Quality assurance
AI training experience
Analytical skills
E-commerce knowledge
20 hours per week commitment

Job description

AI Evaluator – E-Commerce Shopping Assistant

Experience: Experience in data evaluation, quality assurance, or AI training

Job Type: Contractor

Location: Remote

Compensation: $30/hour

Role Overview

We’re seeking AI evaluators to assess a digital shopping assistant’s responses to real-world e-commerce queries. You’ll review user interactions, identify errors and poor recommendations, and create rubrics to evaluate response quality.

Key Responsibilities
  • Review user interaction records with the AI shopping assistant.
  • Identify inaccurate responses, reasoning errors, and unhelpful product recommendations.
  • Create rubrics and verifiers for assessing response quality.
  • Complete at least 20 hours per week of evaluation work on the project platform.
Key Requirements
  • Experience in data evaluation, quality assurance, or AI training.
  • Strong analytical skills and ability to spot subtle errors in text.
  • Familiarity with e-commerce search and online shopping.
  • Able to commit at least 20 hours per week.
  • Candidates on H-1B or STEM OPT are not supported.
Preferred Technical Skills
  • Complex data annotation.
  • Software testing.
  • Building structured evaluation frameworks.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

E-commerce Specialist | Remote
E-commerce Specialist | Remote

Crossing Hurdles • United States

Remote
GBP 27,000 - 35,000
AI Specialist | Remote
AI Specialist | Remote

Crossing Hurdles • United States

Remote
USD 36,000 - 47,000
AI Evaluators: Assessing A Shopping Assistant
AI Evaluators: Assessing A Shopping Assistant

Terac • United States

Remote
USD 34,000 - 49,000
Fully remote
Weekly payments
Remote AI Quality Evaluator - E-Commerce Assistant
Remote AI Quality Evaluator - E-Commerce Assistant

Codefeast • United States

Remote
USD 34,000 - 49,000
Remote AI Quality Evaluator - Shopping Assistant
Remote AI Quality Evaluator - Shopping Assistant

Crossing Hurdles • United States

Remote
USD 36,000 - 47,000
Remote AI Quality Evaluator - E-commerce Shopping Assistant
Remote AI Quality Evaluator - E-commerce Shopping Assistant

Crossing Hurdles • United States

Remote
GBP 27,000 - 35,000
Remote AI Evaluator: Shopping Assistant QA, 20+ hrs/wk
Remote AI Evaluator: Shopping Assistant QA, 20+ hrs/wk

Terac • United States

Remote
USD 34,000 - 49,000
Fully remote
Weekly payments
AI Evaluator | $30/hr Remote
AI Evaluator | $30/hr Remote

Crossing Hurdles • United States

Remote
USD 21,000 - 41,000
E-commerce Data Analyst
E-commerce Data Analyst

Alignerr Corp. • United States

Remote
MXN 384,000 - 716,000
E-commerce Data Analyst
E-commerce Data Analyst

Alignerr • United States

Remote
USD 30,000 - 55,000