Remote Manufacturing Operations Auditor for AI Reviews

Mercor; Sydney; Remote; AUD 108,000 - 127,000; Part time

Job summary

Mercor is seeking a Manufacturing Operations Reviewer for a remote contract role. You will evaluate AI-generated manufacturing content, review AI grader assessments, and assess the defensibility of AI scores. Collaboration with AI research teams will refine grading criteria to improve model performance.

The workload requires independent, asynchronous work and strong English communication. Ideal candidates have extensive experience in purchasing, supervision of production lines, mechanical and

Qualifications

• 5+ years as Buyers and Purchasing Agents with PO experience.
• 5+ years as First-Line Supervisors of Production and Operating Workers.
• 4+ years as Mechanical Engineers; PE a plus.
• 3+ years as Industrial Engineers.
• 4+ years as Shipping, Receiving and Inventory Clerks.
• Near-native business English proficiency.
• Comfort with spreadsheets and PDFs for data reconciliation.

Responsibilities

• Evaluate AI-generated content in manufacturing to ensure task realism and domain accuracy.
• Review AI grader assessments for alignment with industry standards and provide feedback.
• Assess the defensibility of AI-generated scores and provide expert judgment.
• Collaborate with AI research teams to refine grading criteria and improve task evaluations.
• Work independently and asynchronously to meet deadlines and enhance AI model performance.

Skills

Buyer / Purchasing

Production Supervisor

Mechanical Engineering

Industrial Engineering

Shipping / Receiving / Inventory

Business English

Spreadsheet proficiency

PDF data reconciliation

Education

PE license preferred

Tools

Excel

Job description

Mercor is seeking a Manufacturing Operations Reviewer for a remote contract role. You will evaluate AI-generated manufacturing content, review AI grader assessments, and assess the defensibility of AI scores. Collaboration with AI research teams will refine grading criteria to improve model performance.

The workload requires independent, asynchronous work and strong English communication. Ideal candidates have extensive experience in purchasing, supervision of production lines, mechanical and