DataAnnotation is looking for an experienced UI/UX Product Designer - AI Trainer to help evaluate how frontier AI models perform on real visual design tasks. This contract role focuses on interfaces and visual systems, from layout and typography to interaction-driven presentation work, using realistic briefs and careful design critique.
You will develop challenging design prompts, run them through AI design tools, and assess the results against the same standards you would expect from a professional colleague. You will also compare outputs from multiple model versions on identical inputs, documenting what performed better and where each approach breaks down.
What you’ll do
- Create realistic, challenging design briefs based on your professional expertise, grounded in real-world UI and product design expectations.
- Submit briefs to frontier AI design tools and evaluate the output against the standard you would hold for a colleague.
- Compare two model versions using identical prompts and assets, then make a clear call on which performed better and identify specific shortcomings.
- Critique AI-generated work across interfaces, mockups, layouts, slides, infographics, illustrations, and motion.
- Flag concrete failures using evidence, including alignment and spacing, content overflow and cutoff, typography, visual hierarchy, SVG and illustration quality, ignored assets, and off-brief interpretation.
- Contribute across a range of design areas spanning software and interactive work, office and presentation design, technical illustration, graphic design, and new media.
What you bring
- Fluency in English at native or bilingual level.
- Background in UI/UX design, web design, product design, or graphic design.
- Strong understanding of visual hierarchy, layout, typography, interaction design, and user flow.
- Ability to explain why a design fails, not only that it fails.
- Comfort working with AI design tools, or the ability to learn them quickly.
- A current, in-progress, or completed Bachelor’s degree is preferred (not required).
Compensation and contract details
- Job type: Contract
- Location: Evanston, IL (remote)
- Pay: USD $75-$125 per hour
- Bonus rates: available on some projects
How projects work
- Choose which projects you want to work on and when.
- Work on your own schedule using your own computer from home.
- Projects are paid hourly up to $75-$125 USD per hour, with bonus rates on select projects.
Payments and eligibility
- Payment is made via PayPal.
- No money will be requested from you.
- PayPal handles any currency conversions from USD.
- Applicants considered: Australia, Canada, Ireland, New Zealand, the United Kingdom, and the United States.
- This is an independent contractor position.