Remote Conversation Quality Analyst

Alignerr; Mexico; On-site; MXN 248,000 - 413,000; Full time

Job summary

Alignerr is seeking Conversation Quality Analysts to evaluate AI-generated dialogues across a wide range of topics. The role is fully remote as an hourly contract, with flexible scheduling and 10–40 hours per week.

You will rate naturalness, helpfulness, tone, and context, identify awkward phrasing and inconsistencies, compare conversation paths, and provide structured feedback using clear rubrics. No AI background required; strong reading and written communication are key.

Qualifications

• Strong reading comprehension and ability to assess dialogue quality objectively.
• Ability to explain reasoning clearly and consistently.
• Comfortable handling large volumes of text-based content.

Responsibilities

• Read and evaluate AI-generated conversations across a wide range of topics and scenarios.
• Rate responses for naturalness, helpfulness, tone, and contextual relevance.
• Identify awkward phrasing, logical inconsistencies, or responses that miss the mark.
• Compare multiple conversation paths and rank them by overall quality.
• Provide structured, detailed feedback using clear evaluation rubrics.
• Work independently and asynchronously on your own schedule.

Skills

Reading comprehension

Analytical evaluation

Attention to detail

Independent work

Remote work discipline

Job description

Alignerr is seeking Conversation Quality Analysts to evaluate AI-generated dialogues across a wide range of topics. The role is fully remote as an hourly contract, with flexible scheduling and 10–40 hours per week.

You will rate naturalness, helpfulness, tone, and context, identify awkward phrasing and inconsistencies, compare conversation paths, and provide structured feedback using clear rubrics. No AI background required; strong reading and written communication are key.