Remote Architecture AI Model Evaluator (Contract)

mercor; San Francisco (CA); Hybrid; CAD 118,000 - 177,000; Part time

Job summary

Mercor is seeking an Architecture Expert for a remote, contract-based role. You will evaluate AI models on visual document understanding within architecture, and author complex tasks with clear ground-truth outputs and rubrics.

You will review model outputs for accuracy, align them with architectural principles, and collaborate with subject matter experts to ensure coverage. This is a flexible 15–20 hour/week engagement, demanding independent, asynchronous work.

Qualifications

• Expertise in the Architecture domain.
• Experience in authoring complex, grounded tasks.

Responsibilities

• Evaluate AI models on visual document understanding in the Architecture domain.
• Author complex, grounded tasks with clear ground-truth outputs and objective rubrics.
• Review and improve AI model outputs for accuracy and alignment with architectural principles.
• Collaborate with subject matter experts to ensure task relevance and coverage.
• Work independently and asynchronously to meet deadlines and enhance model performance.

Skills

Architectural domain expertise

Task authoring

Job description

Mercor is seeking an Architecture Expert for a remote, contract-based role. You will evaluate AI models on visual document understanding within architecture, and author complex tasks with clear ground-truth outputs and rubrics.

You will review model outputs for accuracy, align them with architectural principles, and collaborate with subject matter experts to ensure coverage. This is a flexible 15–20 hour/week engagement, demanding independent, asynchronous work.