Remote AI Dialogue Quality Analyst

Alignerr Corp.; United States; Remote; MXN 207,000 - 317,000; Part time

Benefits offered by this job

Fully remote

Job summary

Alignerr is seeking a Conversation Quality Analyst to review AI-generated dialogues and judge naturalness, helpfulness, tone, and relevance. This fully remote hourly contract invites individuals with strong reading comprehension who can identify when conversations feel off.

You’ll work asynchronously, assess diverse topics, rank dialogue paths, and deliver structured feedback using clear rubrics. No AI background required, just keen judgment and reliability.

Qualifications

• Strong reading comprehension and natural language understanding.
• Ability to assess dialogue quality objectively and explain reasoning clearly.
• Detail-oriented and consistent in evaluating large volumes of text.

Responsibilities

• Read and evaluate AI-generated conversations across a wide range of topics and scenarios
• Rate responses for naturalness, helpfulness, tone, and contextual relevance
• Identify awkward phrasing, logical inconsistencies, or responses that miss the mark
• Compare multiple conversation paths and rank them by overall quality
• Provide structured, detailed feedback using clear evaluation rubrics
• Work independently and asynchronously on your own schedule

Skills

Reading comprehension

Dialogue quality evaluation

Attention to detail

Explain reasoning clearly

Self-motivated & reliable

Job description

Alignerr is seeking a Conversation Quality Analyst to review AI-generated dialogues and judge naturalness, helpfulness, tone, and relevance. This fully remote hourly contract invites individuals with strong reading comprehension who can identify when conversations feel off.

You’ll work asynchronously, assess diverse topics, rank dialogue paths, and deliver structured feedback using clear rubrics. No AI background required, just keen judgment and reliability.