AI Quality Evaluator - Engineering Ops (Remote, Contract)

mercor; United States; Remote; USD 110,000 - 165,000; Full time

Job summary

Mercor connects elite creative and technical talent with leading AI research labs. The contract role focuses on evaluating AI-generated artifacts in engineering/manufacturing contexts and delivering structured feedback from a remote setting.

The position requires deep domain knowledge, top-tier English fluency, and the ability to work asynchronously to meet deadlines while contributing to model performance improvements.

Qualifications

• 5+ years of relevant experience in engineering or manufacturing operations.
• Native or professional fluency in English.
• Proficient in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors.
• Provide clear, structured written feedback.
• Review AI-generated work products for accuracy, rigor, and domain quality.
• Apply deep subject-matter expertise to grade outputs.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Skills

5+ years experience in Eng/ manuf/ ops

Education

Master's degree or higher

Tools

Microsoft Office

Google Workspace (Slides)

Job description

Mercor connects elite creative and technical talent with leading AI research labs. The contract role focuses on evaluating AI-generated artifacts in engineering/manufacturing contexts and delivering structured feedback from a remote setting.

The position requires deep domain knowledge, top-tier English fluency, and the ability to work asynchronously to meet deadlines while contributing to model performance improvements.