Remote AI Conversation Quality Analyst

Alignerr Corp.; United States; Remote; MXN 304,000 - 507,000; Part time

Job summary

Alignerr is seeking a Conversation Quality Analyst (AI Training) to evaluate AI-generated dialogues and help ensure they are natural, helpful, and clear. This fully remote, hourly contract role offers flexible scheduling with a commitment of 10–40 hours per week.

You will read conversations, rate for naturalness and relevance, identify issues, and provide structured feedback using rubrics. No AI or linguistics background is required.

Qualifications

• Strong reading comprehension and a natural feel for how conversations flow.
• Ability to assess dialogue quality objectively and explain your reasoning clearly.
• Detail-oriented and consistent — you apply the same standards across every evaluation.
• Comfortable working through large volumes of text-based content.
• Self-motivated and reliable when working independently.
• No prior AI, linguistics, or quality assurance experience required.

Responsibilities

• Read and evaluate AI-generated conversations across a wide range of topics and scenarios.
• Rate responses for naturalness, helpfulness, tone, and contextual relevance.
• Identify awkward phrasing, logical inconsistencies, or responses that miss the mark.
• Compare multiple conversation paths and rank them by overall quality.
• Provide structured, detailed feedback using clear evaluation rubrics.
• Work independently and asynchronously on your own schedule.

Skills

Reading comprehension

Analytical thinking

Attention to detail

Clear reasoning

Independent work

Content review

Writing background

Editing

Communications

Customer-facing

Job description

Alignerr is seeking a Conversation Quality Analyst (AI Training) to evaluate AI-generated dialogues and help ensure they are natural, helpful, and clear. This fully remote, hourly contract role offers flexible scheduling with a commitment of 10–40 hours per week.

You will read conversations, rate for naturalness and relevance, identify issues, and provide structured feedback using rubrics. No AI or linguistics background is required.