Conversation Quality Analyst

Alignerr; Mexico; On-site; MXN 248,000 - 413,000; Full time

Job summary

Alignerr is seeking Conversation Quality Analysts to evaluate AI-generated dialogues across a wide range of topics. The role is fully remote as an hourly contract, with flexible scheduling and 10–40 hours per week.

You will rate naturalness, helpfulness, tone, and context, identify awkward phrasing and inconsistencies, compare conversation paths, and provide structured feedback using clear rubrics. No AI background required; strong reading and written communication are key.

Qualifications

• Strong reading comprehension and ability to assess dialogue quality objectively.
• Ability to explain reasoning clearly and consistently.
• Comfortable handling large volumes of text-based content.

Responsibilities

• Read and evaluate AI-generated conversations across a wide range of topics and scenarios.
• Rate responses for naturalness, helpfulness, tone, and contextual relevance.
• Identify awkward phrasing, logical inconsistencies, or responses that miss the mark.
• Compare multiple conversation paths and rank them by overall quality.
• Provide structured, detailed feedback using clear evaluation rubrics.
• Work independently and asynchronously on your own schedule.

Skills

Reading comprehension

Analytical evaluation

Attention to detail

Independent work

Remote work discipline

Job description

Conversation Quality Analyst (AI Training)

About The Role

What if your instinct for natural conversation could directly improve how AI communicates with millions of people? We're looking for Conversation Quality Analysts to evaluate AI-generated dialogues and help ensure they feel genuinely human, helpful, and clear.

This is a fully remote, flexible contract role open to anyone with strong reading comprehension and a sharp sense for how conversation should flow. No AI, linguistics, or technical background required — if you can tell when a conversation feels off, you're already qualified.

• Organization: Alignerr
• Type: Hourly Contract
• Location: Remote
• Commitment: 10–40 hours/week

What You'll Do

• Read and evaluate AI-generated conversations across a wide range of topics and scenarios
• Rate responses for naturalness, helpfulness, tone, and contextual relevance
• Identify awkward phrasing, logical inconsistencies, or responses that miss the mark
• Compare multiple conversation paths and rank them by overall quality
• Provide structured, detailed feedback using clear evaluation rubrics
• Work independently and asynchronously on your own schedule

Who You Are

• Strong reading comprehension and a natural feel for how conversations flow
• Ability to assess dialogue quality objectively and explain your reasoning clearly
• Detail-oriented and consistent — you apply the same standards across every evaluation
• Comfortable working through large volumes of text-based content
• Self-motivated and reliable when working independently
• No prior AI, linguistics, or quality assurance experience required

Nice to Have

• Background in writing, editing, communications, or customer-facing roles
• Experience with content review, quality assurance, or critical analysis
• Familiarity with AI chatbots or conversational tools as an end user

Why Join Us

• Work on cutting-edge AI projects alongside leading research labs
• Fully remote and flexible — work when and where it suits you
• Freelance autonomy with the structure of meaningful, task-based work
• Contribute to AI development that directly shapes how technology communicates with the world
• Potential for ongoing work and contract extension as new projects launch