Experienced Designers: Design Judgment For AI Research

Terac

United States

Remote

USD 34,000 - 49,000

Full time

14 days+
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Terac is conducting a remote study for experienced designers to critique visual design work and translate judgments into structured rubrics. You will review artifacts, explain your decision-making, and help draft evaluation rubrics during a remote session.

Ideal candidates have a proven track record as designers or creative leads, can articulate reasoning, and can produce repeatable assessment criteria. Compensation is $30 per hour.

Qualifications

  • Experience reviewing visual design artifacts and providing actionable feedback.
  • Ability to translate subjective design quality into objective rubrics.
  • Comfortable explaining your design judgments during a remote session.

Responsibilities

  • Review and critique visual design artifacts.
  • Break down intuitive design judgments into structured, repeatable tasks.
  • Draft clear evaluation rubrics for design quality.

Skills

Visual critique
Design feedback
Creative leadership

Job description

What We're Researching

We're running a paid study on how expert designers evaluate and critique creative work. The goal is to translate intuitive design judgment into structured tasks and clear evaluation rubrics. This work directly supports the development of AI models that can better understand and analyze visual design.


How It Works

You will participate in a remote session to review various design artifacts and provide structured feedback. We will ask you to break down your creative decision-making process and explain how you evaluate quality. You will then help us draft evaluation rubrics based on those expert critiques. The session involves screen-sharing and walking us through your analytical workflow.


Who This Is For

We are hiring experienced designers and creative professionals with a strong background in visual critique. We welcome UX/UI designers, graphic designers, art directors, and creative leads. Candidates should have a proven track record of evaluating creative work and building design systems or guidelines.


What You'll Do


  • Review and critique various visual design artifacts

  • Break down intuitive design judgment into structured, repeatable tasks

  • Draft clear evaluation rubrics for assessing design quality

  • Walk us through your creative decision-making process during a remote call


Who Should Apply


  • Professional experience as a designer, art director, or creative lead

  • Strong background in providing visual critique and actionable design feedback

  • Comfortable articulating the reasoning behind creative decisions

  • Ability to translate subjective design quality into objective rubrics


Compensation

$30 per hour


About Terac

Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets. Learn more at or on YouTube at @jointerac.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Design Critique & Evaluation Specialist
Senior Design Critique & Evaluation Specialist

Terac • United States

Remote
USD 34,000 - 49,000
Senior Design Expert - Paid AI Design Research Study
Senior Design Expert - Paid AI Design Research Study

Weekday AI • United States

Remote
USD 207,000 - 344,000
Brand Evaluators: 15-20-Minute Image Evaluation Task
Brand Evaluators: 15-20-Minute Image Evaluation Task

Terac • United States

Remote
USD 97,000 - 138,000
Graphic Design Expert (International)
Graphic Design Expert (International)

HumanSignal • United States

On-site
USD 27,552
Design Specialist - Fully Remote | Upto $250/hr
Design Specialist - Fully Remote | Upto $250/hr

mercor • San Francisco (CA)

Hybrid
GBP 156,000 - 260,000
Strategy And Finance Professionals: AI Systems For Complex Business Work
Strategy And Finance Professionals: AI Systems For Complex Business Work

Terac • United States

Remote
USD 57,000 - 81,000
UX/UI Design Critic - AI Trainer
UX/UI Design Critic - AI Trainer

DataAnnotation • Santa Clara (CA)

On-site
USD 103,000 - 172,000
UX/UI Design Critic - AI Trainer
UX/UI Design Critic - AI Trainer

DataAnnotation • Redmond (WA)

On-site
USD 103,000 - 172,000
Remote UX Design Critique Specialist for AI Interfaces
Remote UX Design Critique Specialist for AI Interfaces

DataAnnotation • Atlanta (GA)

Remote
USD 55,000 - 172,000
Flexible schedule
Remote work
Design Evaluation Expert - Graphic
Design Evaluation Expert - Graphic

Mercor • New York (NY)

On-site
USD 90,000 - 130,000