UX/UI Design Critic - AI Trainer

Designer Jobs; Redmond (WA); On-site; USD 103,000 - 172,000; Full time

Job summary

DataAnnotation is seeking an experienced UX/UI Design Critic - AI Trainer to create realistic design briefs and evaluate frontier AI model outputs against professional design standards. You will run prompts and assets through AI tools and provide evidence-based critique on what meets expectations and what does not.

This contract role is based in Redmond, WA with hourly pay of $75 to $125, offering scheduling flexibility and work from home setup.

Qualifications

• Experience in UI/UX or related design fields.
• Strong understanding of visual hierarchy, layout, typography.
• Ability to explain why a design fails and how to improve it.
• Familiarity with AI design tools or willingness to learn quickly.
• Bachelor’s degree preferred but not required.

Responsibilities

• Develop realistic, expert design briefs for AI training.
• Feed briefs into AI tools and judge outputs against professional standards.
• Compare model versions using identical prompts and assets.
• Critique AI-generated interfaces, layouts, and visuals.
• Document concrete failures with evidence and notes on alignment/spacing.
• Apply critique across multiple design domains and media.

Skills

UI/UX design

Web design

Product design

Graphic design

Explain design failures

Education

Bachelor's degree

Tools

AI design tools

Job description

Build and refine AI-generated design quality from home. DataAnnotation is seeking an experienced UX/UI Design Critic - AI Trainer to create realistic visual design briefs and evaluate frontier AI model outputs against professional design standards. You will run identical prompts and assets through AI tools, compare results across model versions, and provide clear, evidence-based critique on what meets expectations and what does not.

What you’ll do

• Develop challenging, realistic design briefs based on your professional expertise.
• Feed briefs into frontier AI design tools and assess the outputs against the standard you would hold for a colleague.
• Compare two model versions using the same prompts and assets, selecting which performed better and identifying specific shortcomings.
• Critique AI-generated interfaces, mockups, layouts, slides, infographics, illustrations, and motion.
• Document concrete failures with evidence, including alignment and spacing, content overflow or cutoff, typography, visual hierarchy, SVG and illustration quality, ignored assets, and off-brief interpretation.
• Apply your critique skills across multiple domains, including software and interactive work, office and presentation design, technical illustration, graphic design, and new media.

What you bring

• Fluency in English (native or bilingual level).
• Background in UI/UX design, web design, product design, or graphic design.
• Strong understanding of visual hierarchy, layout, typography, interaction design, and user flow.
• Ability to explain why a design fails, not just that it fails.
• Comfort working with AI design tools, or the ability to pick them up quickly.
• A current, in progress, or completed Bachelor’s is preferred but not required.

How this contract works

• Contract role based in Redmond, WA (onsite).
• Hourly pay: USD 75 to 125 per hour, with bonus rates available on some projects.
• Scheduling flexibility: choose which projects you want to work on and when.
• Work setup: on your own schedule, on your own computer, with work done from the comfort of your home.

Compensation and payment

• Payment is made via PayPal.
• PayPal handles any currency conversions from USD.

Notes

• We will never ask you for money.
• Only applicants in Australia, Canada, Ireland, New Zealand, the United Kingdom, and the United States will be considered.
• This is an independent contractor position.