Remote GIS & AI Model Evaluation Specialist

mercor; United States; Remote; USD 69,000 - 96,000; Part time

Job summary

Mercor is hiring for a Surveying & GIS — Visual Document Understanding role. This contract position is fully remote, offering $50/hour with a commitment of 15–20 hours per week.

You will evaluate AI models on visual document understanding within the Surveying & GIS domain and craft grounded tasks with clear rubrics to guide model performance. The role emphasizes independent, asynchronous work and collaboration with subject matter experts to ensure dataset quality and alignment with domain

Qualifications

• Expertise in Surveying & GIS.
• Experience with AI model evaluation.
• Ability to create objective rubrics and ground-truth outputs.

Responsibilities

• Evaluate the accuracy of AI models in visual document understanding within the Surveying & GIS domain.
• Author complex, grounded tasks with clear ground-truth outputs and objective rubrics.
• Review and refine AI-generated content to ensure alignment with domain principles.
• Provide structured feedback to enhance AI model training and evaluation processes.
• Collaborate with subject matter experts to maintain consistency and relevance across datasets.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Skills

Surveying & GIS

AI model evaluation

Ground-truth outputs

Job description

Mercor is hiring for a Surveying & GIS — Visual Document Understanding role. This contract position is fully remote, offering $50/hour with a commitment of 15–20 hours per week.

You will evaluate AI models on visual document understanding within the Surveying & GIS domain and craft grounded tasks with clear rubrics to guide model performance. The role emphasizes independent, asynchronous work and collaboration with subject matter experts to ensure dataset quality and alignment with domain