AI Evaluator - Software Expert

mercor; United States; Teletrabalho; USD 110 000 - 165 000; Tempo integral

Resumo da oferta

Mercor, a San Francisco-based company connecting top software and AI talent with research labs, is seeking a Contract Software/AI/IT/Data Evaluator for remote work. You will review AI-generated artifacts, grade quality, and provide clear feedback to improve model outputs.

Requires 5+ years in Software/AI/IT/Data, native or professional English, and mastery of Microsoft Office and Google Workspace (Slides). An advanced degree is preferred.

Qualificações

• 5+ years of relevant professional experience in Software / AI / IT / data.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Responsabilidades

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
• Provide clear, structured written feedback to improve AI model outputs.
• Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
• Work independently and asynchronously to meet deadlines.

Conhecimentos

English fluency

5+ years experience

Formação académica

Master's degree

Ferramentas

Microsoft Office

Google Workspace

Google Slides

Descrição da oferta de emprego

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote

Role Responsibilities

• Evaluate AI-generated artifacts against domain-specific quality rubrics.
• Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
• Provide clear, structured written feedback to improve AI model outputs.
• Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
• Work independently and asynchronously to meet deadlines.

Qualifications

Must-Have

• 5+ years of relevant professional experience in Software / AI / IT / data.
• Native or professional fluency in English.
• Highly proficient in Microsoft Office and Google Workspace , especially Slides.

Preferred

• Advanced degree ( Master's or higher ) from a reputable institution.