Remote AI Manufacturing Evaluator (Contract)

Mercor; England; Remote; GBP 57,000 - 68,000; Full time

Job summary

Mercor connects elite creative and technical talent with leading AI research labs. This remote contract role asks for deep expertise in evaluating AI-generated content, reviewing AI grader assessments, and judging defensibility of AI scores.

You will work with AI research teams to refine grading criteria and operate independently to meet deadlines. Ideal candidates have 5+ years across multiple roles including buyers, supervisors, mechanical and industrial engineering, and warehouse operations,

Qualifications

• 5+ years as Buyers and Purchasing Agents with experience in placing POs and supplier negotiations.
• 5+ years as First-Line Supervisors of Production and Operating Workers managing shifts or lines.
• 4+ years as Mechanical Engineers designing parts or systems; PE a plus.
• 3+ years as Industrial Engineers conducting capacity, throughput, or layout studies.
• 4+ years as Shipping, Receiving and Inventory Clerks managing warehouse operations.
• Near-native business English proficiency.
• Comfort with spreadsheets and PDFs for data reconciliation.

Responsibilities

• Evaluate AI-generated content in manufacturing to ensure task realism and domain accuracy.
• Review AI grader assessments for alignment with industry standards and provide feedback.
• Assess the defensibility of AI-generated scores and provide expert judgment.
• Collaborate with AI research teams to refine grading criteria and improve task evaluations.
• Work independently and asynchronously to meet deadlines and enhance AI model performance.

Job description

Mercor connects elite creative and technical talent with leading AI research labs. This remote contract role asks for deep expertise in evaluating AI-generated content, reviewing AI grader assessments, and judging defensibility of AI scores.

You will work with AI research teams to refine grading criteria and operate independently to meet deadlines. Ideal candidates have 5+ years across multiple roles including buyers, supervisors, mechanical and industrial engineering, and warehouse operations,