Conversation Quality Analyst

Alignerr; United States; Remote; GBP 14,000 - 55,000; Part time

Job summary

Alignerr is seeking Conversation Quality Analysts to evaluate AI-generated dialogues and ensure they feel natural, clear, and helpful. This is a fully remote, flexible hourly contract role open to anyone with sharp language instincts and a critical eye.

No AI, linguistics, or technical background required — just a strong feel for how good conversation works. What You'll Do: Read and evaluate AI-generated conversations, rate naturalness and tone, identify issues, compare paths, and submit

Qualifications

• Strong reading comprehension and a natural sense for how conversation should flow.
• Ability to assess dialogue quality objectively and explain your reasoning clearly.
• Detail-oriented and consistent with high-volume workloads.

Responsibilities

• Read and evaluate AI-generated conversations across a wide range of topics and contexts
• Rate responses for naturalness, tone, helpfulness, and conversational flow
• Identify awkward phrasing, off-topic replies, or robotic-sounding language
• Compare multiple conversation paths and rank them by overall quality
• Submit structured, detailed evaluations using provided rubrics and rating tools
• Work independently and asynchronously on your own schedule

Job description

Conversation Quality Analyst (AI Training)

About The Role

What if your instinct for natural conversation could directly influence how millions of people experience AI every day? We're looking for Conversation Quality Analysts to evaluate AI-generated dialogues and help ensure they feel genuinely human — clear, helpful, and natural. This is a fully remote, flexible contract role open to anyone with sharp language instincts and a critical eye. No AI, linguistics, or technical background required — just a strong feel for how good conversation works.

• Organization: Alignerr
• Type: Hourly Contract
• Location: Remote
• Commitment: 10–40 hours/week

What You'll Do

• Read and evaluate AI-generated conversations across a wide range of topics and contexts
• Rate responses for naturalness, tone, helpfulness, and conversational flow
• Identify awkward phrasing, off-topic replies, logical inconsistencies, or robotic-sounding language
• Compare multiple conversation paths and rank them by overall quality
• Submit structured, detailed evaluations using provided rubrics and rating tools
• Work independently and asynchronously on your own schedule

Who You Are

• Strong reading comprehension and a natural sense for how conversation should flow
• Able to assess dialogue quality objectively and explain your reasoning clearly
• Detail-oriented and consistent — you apply the same standard across large volumes of work
• Self-motivated and reliable when working independently
• Comfortable working through high volumes of text-based tasks
• No prior AI, linguistics, or tech experience required

Nice to Have

• Background in writing, editing, communications, or customer-facing roles
• Experience with quality assurance, content review, or critical analysis
• Familiarity with AI chatbots or conversational tools as an end user

Why Join Us

• Work on cutting-edge AI projects alongside leading research labs
• Fully remote and flexible — work when and where it suits you
• Freelance autonomy with the structure of meaningful, task-based work
• Contribute to AI development that directly shapes how technology communicates with the world
• Potential for ongoing work and contract extension as new projects launch