Remote AI Product Quality Analyst

Crossing Hurdles; United States; Remote; CAD 70,000 - 90,000; Full time

Job summary

A leading technology company in Canada is seeking an experienced UX evaluator to design evaluation rubrics for AI model outputs and assess user experience. The candidate will execute product validation tasks, analyze AI outputs for usability issues, and collaborate across teams to develop actionable recommendations. Strong communication and analytical skills are essential, along with experience in evaluation frameworks. This role is fully remote, ideal for a self-directed professional.

Qualifications

• Exceptional written and verbal communication skills.
• Strong analytical skills focused on user risk and usability.
• Experience in developing evaluation frameworks focusing on UX and safety.
• Ability to document findings in a user-friendly manner.
• Comfortable collaborating in a fast-paced environment.
• Self-directed and reliable in a fully remote setting.

Responsibilities

• Design and develop evaluation rubrics for AI model outputs.
• Execute product validation tasks to identify UX risks.
• Analyze AI outputs to flag usability issues.
• Collaborate with teams to define product validation standards.
• Translate user insights into actionable recommendations.
• Document results clearly for stakeholder understanding.
• Monitor AI product usage to surface emerging UX risks.

Skills

Exceptional communication skills

Strong analytical skills

Experience with evaluation frameworks

Ability to document findings clearly

Collaboration in fast-paced environments

Self-directed work style

Job description

A leading technology company in Canada is seeking an experienced UX evaluator to design evaluation rubrics for AI model outputs and assess user experience. The candidate will execute product validation tasks, analyze AI outputs for usability issues, and collaborate across teams to develop actionable recommendations. Strong communication and analytical skills are essential, along with experience in evaluation frameworks. This role is fully remote, ideal for a self-directed professional.