Visual Systems Evaluator - AI Trainer

DataAnnotation; Atlanta (GA); Remote; USD 55,000 - 172,000; Full time

Benefits offered by this job

Flexible schedule

Remote work

Job summary

DataAnnotation is where 100k+ experts train the world’s leading AI models. We’re looking for a Designer to evaluate AI design work and write critique that teaches the next generation what good design actually is. Flexible, remote, and always project-available.

You’ll assess user flows, layout, typography, and accessibility, catching polish failures and producing clear, actionable feedback for model improvements. Compensation ranges widely based on task complexity.

Qualifications

• Professional experience in product, UX, or visual design, with a portfolio to back it.
• Sharp eye for usability, hierarchy, typography, and accessibility.
• Clear written English: your explanations are the training signal.

Responsibilities

• Evaluate AI design work across user flows, layout, and visual hierarchy, and judge whether it actually serves the user.
• Catch the failures under the polish: clumsy flows, weak hierarchy, and accessibility problems a pretty mockup hides.
• Write the stronger critique when the model falls short, with the design rationale a good reviewer would give.

Skills

UX design

Portfolio

Clear written English

Job description

Models can generate a slick-looking screen and completely miss the point: the flow that adds three needless steps, the hierarchy that buries the one action that matters, the contrast that fails the moment someone actually needs to read it. Someone has to tell polish from good design, and that someone is you.

As a Designer you'll evaluate how models reason about UX and visual design, catch the choices that look fine and fail users, and write the critique that teaches the next generation what good design actually is.

What you’ll actually do

• Evaluate AI design work across user flows, layout, and visual hierarchy, and judge whether it actually serves the user.
• Catch the failures under the polish: clumsy flows, weak hierarchy, and accessibility problems a pretty mockup hides.
• Write the stronger critique when the model falls short, with the design rationale a good reviewer would give.

What we look for

• Professional experience in product, UX, or visual design, with a portfolio to back it.
• Sharp eye for usability, hierarchy, typography, and accessibility.
• Clear written English: your explanations are the training signal.
• No degree required. We care about what you can do, not where you learned it.

Compensation

Up to $40 – $125+/hr depending on task difficulty and specialization. Many contributors add $10k–$100k+ a year; some make it their full-time income.

About DataAnnotation

DataAnnotation is where 100k+ experts train the world’s leading AI models. $150M+ paid to contributors to date, and the average contributor stays 5+ years.

• Flexible, remote, and always project-available.