Remote UI/UX Design Specialist – AI Evaluation & Systems

United States Digital Space LLC; United States; Remote; USD 124,000 - 207,000; Full time

Job summary

Mercor is seeking a UI/UX Design Expert for a remote contract role. The candidate will design precise grading criteria for real-world digital product UX deliverables and evaluate AI-generated and human work samples against robust criteria.

Responsibilities include applying evidence-based judgment, incorporating feedback from senior reviewers, and iterating quickly. The role requires independence and asynchronous work to improve AI model performance.

Qualifications

• 5+ years of professional experience in product design, UI/UX, or design systems.
• Background at leading digital-product and UX studios or in-house product-design teams.
• Experience in Product / UI / Design Systems Design, UX Lead, or UX Writing.
• Deep fluency in interaction and visual design, design systems, and Figma.
• Exceptionally strong written communication skills.

Responsibilities

• Design precise, task-specific grading criteria for real-world digital product and UX deliverables.
• Score AI-generated and human work samples against criteria with detailed written justifications.
• Apply consistent, evidence-based judgment for reproducible and defensible scores.
• Incorporate structured feedback from senior reviewers and iterate quickly on work.
• Work independently and asynchronously to evaluate and improve AI model performance.

Skills

UI/UX design

Design systems

Figma

Written communication

Job description

Mercor is seeking a UI/UX Design Expert for a remote contract role. The candidate will design precise grading criteria for real-world digital product UX deliverables and evaluate AI-generated and human work samples against robust criteria.

Responsibilities include applying evidence-based judgment, incorporating feedback from senior reviewers, and iterating quickly. The role requires independence and asynchronous work to improve AI model performance.