Conversation Quality Analyst

Alignerr Corp.; Italy; Remote; EUR 14,000 - 55,000; Full time

Job summary

Alignerr is seeking a Conversation Quality Analyst to review AI-generated dialogues and help ensure AI sounds helpful, natural, and human. This fully remote, flexible contract role is open to anyone with strong reading comprehension and a sharp ear for language.

You will read conversations, rate quality on naturalness and relevance, identify issues, and submit structured evaluations. This freelance position offers autonomy with a schedule that fits your life and the potential for ongoing work.

Qualifications

• Strong reading comprehension and an intuitive sense of how natural conversation flows.
• Ability to assess dialogue quality objectively and articulate reasoning clearly.
• Detail-oriented and consistent with uniform evaluation across many items.

Responsibilities

• Read and evaluate AI-generated conversations across topics.
• Rate dialogue quality on naturalness, helpfulness, tone, and relevance.
• Identify awkward phrasing, off-topic responses, logical errors, or unnatural flow.
• Compare conversation paths and rank them by overall quality.
• Submit structured evaluations using provided rubrics and rating tools.
• Work independently and asynchronously on your own schedule.

Skills

Reading comprehension

Critical thinking

Attention to detail

Independent work

Communication

Job description

Conversation Quality Analyst (AI Training)

About The Role

What if your instinct for natural conversation could directly shape how AI communicates with millions of people? We're looking for Conversation Quality Analysts to review and evaluate AI-generated dialogues — helping ensure that AI sounds genuinely helpful, natural, and human. This is a fully remote, flexible contract role open to anyone with strong reading comprehension and a sharp ear for how language works. No background in AI, linguistics, or tech required — just a reliable internet connection and a commitment to thoughtful, consistent work.

• Organization: Alignerr
• Type: Hourly Contract
• Location: Remote
• Commitment: 10–40 hours/week

What You'll Do

• Read and evaluate AI-generated conversations across a wide range of topics and scenarios
• Rate dialogue quality on dimensions like naturalness, helpfulness, tone, and relevance
• Identify awkward phrasing, off-topic responses, logical errors, or unnatural flow
• Compare multiple conversation paths and rank them by overall quality
• Submit structured, detailed evaluations using provided rubrics and rating tools
• Work independently and asynchronously on your own schedule

Who You Are

• Strong reading comprehension and an intuitive sense of how natural conversation flows
• Able to assess dialogue quality objectively and articulate your reasoning clearly
• Detail-oriented and consistent — you apply the same standard across many evaluations
• Comfortable working through large volumes of text-based content
• Self-motivated and reliable when working independently
• No AI, linguistics, or content moderation experience required

Nice to Have

• Background in writing, editing, communications, or customer service
• Experience with quality assurance, research, or critical analysis
• Familiarity with AI chatbots or conversational tools as an end user

Why Join Us

• Work on cutting-edge AI projects alongside leading research labs
• Fully remote and flexible — work when and where it suits you
• Freelance autonomy with the structure of meaningful, task-based work
• Contribute to AI development that directly shapes how technology communicates with the world
• Potential for ongoing work and contract extension as new projects launch