Conversation Quality Analyst

Alignerr Corp.; España; Remote; EUR 25,000 - 42,000; Part time

Job summary

Alignerr is seeking a Conversation Quality Analyst (AI Training) to review AI-generated dialogues and rate their naturalness, usefulness, and clarity. This fully remote hourly contract role fits flexible schedules and does not require prior AI or linguistics background.

You will read diverse conversations, compare paths, provide structured feedback, and work asynchronously on your own timetable, contributing to ongoing AI quality improvements with scalable impact.

Qualifications

• Strong reading comprehension and intuitive sense for natural language.
• Ability to assess conversation quality objectively and explain your reasoning clearly.
• Detail-oriented and consistent — you apply the same standard across every evaluation.
• Comfortable working through large volumes of dialogue efficiently.
• Self-motivated and reliable when working independently.

Responsibilities

• Read and evaluate AI-generated conversations across a wide range of topics and scenarios.
• Assess responses for naturalness, helpfulness, tone, and contextual relevance.
• Identify awkward phrasing, logical errors, irrelevant replies, or unnatural flow.
• Compare multiple conversation paths and rank them by overall quality.
• Submit structured, detailed evaluations using provided rating rubrics.
• Work independently and asynchronously on your own schedule.

Skills

Reading comprehension

Attention to detail

Independent work

Analytical thinking

Strong communication

Job description

Conversation Quality Analyst (AI Training)

About The Role

What if your instinct for natural conversation could directly shape how AI communicates with millions of people? We're looking for Conversation Quality Analysts to evaluate AI-generated dialogues and help ensure they feel genuinely human — clear, helpful, and natural. This is a fully remote, flexible contract role open to anyone with strong reading comprehension and a sharp ear for how people actually talk. No AI or linguistics background required — if you can tell the difference between a great conversation and an awkward one, you're already qualified.

• Organization: Alignerr
• Type: Hourly Contract
• Location: Remote
• Commitment: 10–40 hours/week

What You’ll Do

• Read and evaluate AI-generated conversations across a wide range of topics and scenarios
• Assess responses for naturalness, helpfulness, tone, and contextual relevance
• Identify awkward phrasing, logical errors, irrelevant replies, or unnatural flow
• Compare multiple conversation paths and rank them by overall quality
• Submit structured, detailed evaluations using provided rating rubrics
• Work independently and asynchronously on your own schedule

Who You Are

• Strong reading comprehension and an intuitive sense for natural language
• Able to assess conversation quality objectively and explain your reasoning clearly
• Detail-oriented and consistent — you apply the same standard across every evaluation
• Comfortable working through large volumes of dialogue efficiently
• Self-motivated and reliable when working independently
• No prior AI, linguistics, or NLP experience required

Nice to Have

• Background in writing, editing, communications, or content review
• Experience with quality assurance, research, or critical analysis
• Familiarity with AI chatbots or conversational tools as an end user

Why Join Us

• Work on cutting-edge AI projects alongside leading research labs
• Fully remote and flexible — work when and where it suits you
• Freelance autonomy with the structure of meaningful, task-based work
• Contribute directly to AI development that shapes how technology communicates with the world
• Potential for ongoing work and contract extension as new projects launch