Conversation Quality Analyst

Alignerr Corp.; Portugal; Remote; EUR 17,000 - 28,000; Part time

Job summary

Alignerr Corp. is seeking a Conversation Quality Analyst (AI Training) to review and evaluate AI-generated dialogues, ensuring responses are helpful, contextually appropriate, and naturally human. This is a fully remote, hourly contract role with flexible hours (10–40 hours/week).

No AI background or linguistics degree required—just strong reading comprehension and an eye for conversational quality. You'll work asynchronously, read and rate conversations across topics, and provide structured

Qualifications

• Strong reading comprehension and an intuitive sense for how natural conversation works.
• Able to evaluate dialogue quality objectively and explain your reasoning clearly.
• Detail-oriented and consistent — you apply the same standards across large volumes of work.
• Comfortable working through high volumes of written dialogue independently.
• Self-motivated and reliable when working without supervision.
• No prior AI, linguistics, or content evaluation experience required.

Responsibilities

• Read and evaluate AI-generated conversations across a wide range of topics and contexts
• Assess responses for naturalness, helpfulness, tone, and conversational flow
• Identify awkward phrasing, off-topic replies, logical inconsistencies, or unnatural dialogue patterns
• Compare multiple conversation paths and rank them by overall quality
• Submit structured, detailed evaluations using provided rubrics and rating tools
• Work independently and asynchronously on your own schedule

Job description

Conversation Quality Analyst (AI Training)

About The Role

What if your instinct for natural conversation could directly shape how AI communicates with millions of people? We're looking for Conversation Quality Analysts to review and evaluate AI-generated dialogues — helping ensure that AI responses feel genuinely helpful, contextually appropriate, and naturally human.

This is a fully remote, flexible contract role open to anyone with strong reading comprehension and a good ear for how conversation should flow. No AI background, linguistics degree, or technical experience required.

• Organization: Alignerr
• Type: Hourly Contract
• Location: Remote
• Commitment: 10–40 hours/week

What You'll Do

• Read and evaluate AI-generated conversations across a wide range of topics and contexts
• Assess responses for naturalness, helpfulness, tone, and conversational flow
• Identify awkward phrasing, off-topic replies, logical inconsistencies, or unnatural dialogue patterns
• Compare multiple conversation paths and rank them by overall quality
• Submit structured, detailed evaluations using provided rubrics and rating tools
• Work independently and asynchronously on your own schedule

Who You Are

• Strong reading comprehension and an intuitive sense for how natural conversation works
• Able to evaluate dialogue quality objectively and explain your reasoning clearly
• Detail-oriented and consistent — you apply the same standards across large volumes of work
• Comfortable working through high volumes of written dialogue independently
• Self-motivated and reliable when working without supervision
• No prior AI, linguistics, or content evaluation experience required

Nice to Have

• Background in writing, editing, communications, or customer service
• Experience with quality assurance, research, or critical analysis
• Familiarity with AI tools or chatbots as an everyday user

Why Join Us

• Work on cutting-edge AI projects alongside leading research labs
• Fully remote and flexible — work when and where it suits you
• Freelance autonomy with the structure of meaningful, task-based work
• Contribute directly to AI development that shapes how technology communicates with the world
• Potential for ongoing work and contract extension as new projects launch