AI-Driven UX/UI Designer & Evaluation Specialist

The Ai Training Company; Polska; Remote; PLN 75,000 - 110,000; Full time

Job summary

The Ai Training Company is seeking experienced product designers, UX/UI designers, and related roles to create and annotate evaluation tasks for advanced AI systems. You will analyze task flows, identify key events, and apply structured labeling to assess performance and outcomes.

Candidates with backgrounds in design systems, rapid prototyping, and AI-native product development are encouraged. This role requires precision, consistency, and the ability to collaborate with remote teams while

Qualifications

• Professional or academic background in UX/UI, product design, video editing, photography, multimedia, engineering, data annotation, or a closely related field
• Strong visual attention to detail
• Ability to analyze video content carefully
• Comfortable applying detailed annotation and grading guidelines
• Ability to work consistently across repetitive review tasks
• Ability to explain annotation decisions clearly
• Comfortable learning new annotation tools
• Strong organizational skills
• Ability to meet deadlines
• Comfortable collaborating with remote teams
• Ability to work independently while maintaining high quality

Responsibilities

• Analyze task execution frame by frame when necessary
• Identify important actions, events, behaviors, and outcomes
• Apply structured labels, tags, and grades based on project guidelines
• Mark timestamps or video segments corresponding to key events
• Determine whether tasks were completed correctly
• Identify partial completions, failed actions, mistakes, or unusual behavior
• Document observations and evaluation rationales clearly
• Apply annotation guidelines consistently across large volumes of videos
• Participate in reviewer calibration and quality discussions
• Collaborate asynchronously with project trainers and other contributors
• Flag unclear or ambiguous cases for additional review
• Provide feedback on labeling guidelines and annotation workflows
• Organize and submit completed annotations within project timelines
• Maintain high standards for precision, consistency, and quality

Skills

Product design

UX/UI design

Attention to detail

Remote collaboration

Deadline-driven

Job description

The Ai Training Company is seeking experienced product designers, UX/UI designers, and related roles to create and annotate evaluation tasks for advanced AI systems. You will analyze task flows, identify key events, and apply structured labeling to assess performance and outcomes.

Candidates with backgrounds in design systems, rapid prototyping, and AI-native product development are encouraged. This role requires precision, consistency, and the ability to collaborate with remote teams while