Remote AI Arts & Humanities Evaluator (Contract)

Mercor; San Francisco (CA); Hybrid; AUD 154,000 - 231,000; Part time

Job summary

Mercor is seeking a Humanities/Arts/Culture Evaluator for a remote, contract role. You will assess AI-generated artifacts against quality rubrics, identify errors, and provide structured feedback to improve model performance. Collaboration with subject-matter experts and independent, asynchronous work style are required.

Must have 5+ years in humanities/arts, native or professional English fluency, and advanced MS Office/Google Workspace skills. An advanced degree is preferred.

Qualifications

• 5+ years of relevant professional experience in humanities/arts/culture.
• Native or professional fluency in English.
• Proficiency in Microsoft Office and Google Workspace, especially Slides.
• Advanced degree (Master's or higher) from a reputable institution.

Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors in AI outputs.
• Provide clear, structured written feedback to improve AI model performance.
• Collaborate with subject matter experts to ensure consistency and quality.
• Work independently and asynchronously to meet deadlines while enhancing AI model outputs.

Skills

Experience in humanities

English fluency

MS Office & Google Workspace

Education

Master's degree or higher

Tools

Microsoft Office

Google Workspace

Google Slides

Job description

Mercor is seeking a Humanities/Arts/Culture Evaluator for a remote, contract role. You will assess AI-generated artifacts against quality rubrics, identify errors, and provide structured feedback to improve model performance. Collaboration with subject-matter experts and independent, asynchronous work style are required.

Must have 5+ years in humanities/arts, native or professional English fluency, and advanced MS Office/Google Workspace skills. An advanced degree is preferred.