Remote AI Conversation Quality Analyst (Contract)

Alignerr Corp.; Portugal; Remote; EUR 17,000 - 30,000; Full time

Job summary

Alignerr is seeking Conversation Quality Analysts for a fully remote, flexible contract role. You will review AI-generated dialogues to ensure they are helpful, contextually appropriate, and natural-sounding.

The role offers 10–40 hours per week on an hourly contract basis, with remote work and no strict AI background required. Applicants should demonstrate strong reading comprehension, objective evaluation skills, and the ability to work independently on a flexible schedule.

Qualifications

• Strong reading comprehension and an intuitive sense for natural conversation.
• Ability to evaluate dialogue quality objectively and explain reasoning clearly.
• Detail-oriented and consistent across large volumes of work.

Responsibilities

• Read and evaluate AI-generated conversations across a wide range of topics and contexts.
• Assess responses for naturalness, helpfulness, tone, and conversational flow.
• Identify awkward phrasing, off-topic replies, logical inconsistencies, or unnatural dialogue patterns.
• Compare multiple conversation paths and rank them by overall quality.
• Submit structured, detailed evaluations using provided rubrics and rating tools.
• Work independently and asynchronously on your own schedule.

Skills

Reading comprehension

Objective evaluation

Attention to detail

Independent work

Self-motivation

Job description

Alignerr is seeking Conversation Quality Analysts for a fully remote, flexible contract role. You will review AI-generated dialogues to ensure they are helpful, contextually appropriate, and natural-sounding.

The role offers 10–40 hours per week on an hourly contract basis, with remote work and no strict AI background required. Applicants should demonstrate strong reading comprehension, objective evaluation skills, and the ability to work independently on a flexible schedule.