AI Procurement & Vendor Quality Evaluator (Remote)

Mercor; San Francisco (CA); Remote; GBP 82,000 - 123,000; Full time

Job summary

Mercor is seeking a Procurement / Vendor Management Evaluator for a remote contract position. The role focuses on assessing AI-generated artifacts, identifying errors, and providing structured feedback to improve AI model outputs.

You will collaborate with AI research teams to enhance output quality and work independently to meet tight deadlines. Required are 5+ years in procurement/vendor management, native or professional English, and strong proficiency in MS Office and Google Workspace,

Qualifications

• 5+ years of relevant professional experience in Procurement / vendor management.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
• Provide clear, structured written feedback to improve AI model outputs.
• Collaborate with AI research teams to enhance the quality and accuracy of outputs.
• Work independently and asynchronously to meet deadlines while ensuring high-quality evaluations.

Skills

Procurement / vendor management

English fluency

MS Office

Google Workspace

Education

Master's degree or higher

Tools

Microsoft Office

Google Workspace

Slides

Job description

Mercor is seeking a Procurement / Vendor Management Evaluator for a remote contract position. The role focuses on assessing AI-generated artifacts, identifying errors, and providing structured feedback to improve AI model outputs.

You will collaborate with AI research teams to enhance output quality and work independently to meet tight deadlines. Required are 5+ years in procurement/vendor management, native or professional English, and strong proficiency in MS Office and Google Workspace,