Remote CAD & AI Evaluation Specialist

mercor; San Francisco (CA); Hybrid; CAD 84,000 - 114,000; Part time

Job summary

Mercor connects elite creative and technical talent with leading AI research labs. Remote contract role for Mechanical & CAD — Visual Document Understanding, offering 15–20 hours weekly at $50/hour.

Evaluate AI models, develop rubrics, and collaborate with experts to ensure dataset quality and relevance. This contract role suits self-motivated professionals who can work asynchronously to meet deadlines.

Qualifications

• Expertise in the Mechanical & CAD domain.
• Experience with AI model evaluation and visual document understanding.

Responsibilities

• Evaluate the accuracy of AI models in visual document understanding within the Mechanical & CAD domain.
• Author complex, grounded tasks with clear ground-truth outputs and objective rubrics.
• Develop evaluation rubrics and benchmarks for assessing AI-generated tasks .
• Collaborate with subject matter experts to ensure consistency and relevance across datasets.
• Work independently and asynchronously to meet deadlines and improve AI model performance .

Skills

Mechanical & CAD

AI model evaluation

Job description

Mercor connects elite creative and technical talent with leading AI research labs. Remote contract role for Mechanical & CAD — Visual Document Understanding, offering 15–20 hours weekly at $50/hour.

Evaluate AI models, develop rubrics, and collaborate with experts to ensure dataset quality and relevance. This contract role suits self-motivated professionals who can work asynchronously to meet deadlines.