Remote UI/UX Design Specialist for AI Evaluation

mercor; Canada; Remote; CAD 157,000 - 294,000; Part time

Job summary

Mercor is seeking a UI/UX Design Expert for a remote contract role focused on grading criteria for digital product UX and AI evaluation. The position requires independence and the ability to work asynchronously.

You will score AI-generated and human work samples, provide detailed written justifications, and iteratively improve scores with senior reviewers. Strong communication and design-systems fluency are essential.

Qualifications

• 5+ years of professional experience in product design, UI/UX, or design systems.
• Background at leading digital-product and UX studios or in-house product-design teams.
• Experience in Product/UI/Design Systems Design, UX Lead, or UX Writing.
• Deep fluency in interaction and visual design, design systems, and Figma.
• Exceptionally strong written communication skills.
• Detail-oriented and comfortable with peer-reviewed judgment.

Responsibilities

• Design precise, task-specific grading criteria for real-world digital product and UX deliverables.
• Score AI-generated and human work samples against criteria with detailed written justifications.
• Apply consistent, evidence-based judgment for reproducible and defensible scores.
• Incorporate structured feedback from senior reviewers and iterate quickly on work.
• Work independently and asynchronously to evaluate and improve AI model performance.

Skills

UX design

Design systems

Written communication

Independent work

Tools

Figma

Job description

Mercor is seeking a UI/UX Design Expert for a remote contract role focused on grading criteria for digital product UX and AI evaluation. The position requires independence and the ability to work asynchronously.

You will score AI-generated and human work samples, provide detailed written justifications, and iteratively improve scores with senior reviewers. Strong communication and design-systems fluency are essential.