Remote AI Visual Document Evaluation Consultant

mercor; United States; Remote; USD 58,000 - 80,000; Part time

Job summary

Mercor is seeking a contractor for Management Consulting — Visual Document Understanding, remotely in the United States. The role involves evaluating AI-generated content, authoring grounded tasks with clear rubrics, and reviewing visual understanding tasks to ensure quality and alignment with domain principles.

Responsibilities include providing feedback to AI teams and collaborating with experts to improve dataset coverage and model performance while working asynchronously to meet deadlines.

Qualifications

• Expertise in Management Consulting.
• Strong understanding of visual document understanding.
• Ability to create objective rubrics for task evaluation.

Responsibilities

• Evaluate the accuracy and depth of AI-generated content in the Management Consulting domain to strengthen reasoning and rigor in model outputs.
• Author complex, grounded tasks with clear ground-truth outputs and objective rubrics.
• Review visual document understanding tasks for alignment with domain principles and methodologies.
• Provide structured feedback to AI research teams to improve training data quality and downstream performance.
• Collaborate with subject matter experts to ensure consistency, relevance, and coverage across datasets.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Skills

Management Consulting

Visual Document Understanding

Rubric design

Job description

Mercor is seeking a contractor for Management Consulting — Visual Document Understanding, remotely in the United States. The role involves evaluating AI-generated content, authoring grounded tasks with clear rubrics, and reviewing visual understanding tasks to ensure quality and alignment with domain principles.

Responsibilities include providing feedback to AI teams and collaborating with experts to improve dataset coverage and model performance while working asynchronously to meet deadlines.