AI Conversation Quality & Context Specialist

Turing; United States; Remote; USD 83,000 - 117,000; Full time

Job summary

Turing is seeking Subject Matter Experts to review AI conversations and assess whether sufficient context was gathered before recommendations were made. You will identify missed opportunities for clarification and provide structured feedback to improve conversational quality.

The role emphasizes qualitative evaluation, collaboration with research teams, and ensuring high-quality assessments across real-world scenarios.

Qualifications

• 3–5 years of direct practice experience in at least one listed field.
• Licensed Social Work: MSW or equivalent; LCSW/LICSW/LMSW credentials.
• Counseling/Psychology: MA/MS with LMFT/LPC/LCPC or PhD/PsyD; client-facing experience.
• Qualitative Research/HCI/Communication: MA/PhD in HCI or related field; qualitative research experience.
• Mediation/Coaching/Advisory: substantial advisory/client-facing experience; based in USA/Canada/Western Europe.

Responsibilities

• Review AI conversations involving real-world interpersonal and everyday decision-making scenarios.
• Identify missing context and recommend relevant follow-up questions.
• Evaluate whether additional information would have changed the AI's recommendations.
• Distinguish between critical (load-bearing) and non-essential information.
• Conduct qualitative reviews and document findings using structured evaluation guidelines.
• Collaborate with research teams to ensure consistent, high-quality assessments.

Skills

Business Analysis

Education

Job description

Turing is seeking Subject Matter Experts to review AI conversations and assess whether sufficient context was gathered before recommendations were made. You will identify missed opportunities for clarification and provide structured feedback to improve conversational quality.

The role emphasizes qualitative evaluation, collaboration with research teams, and ensuring high-quality assessments across real-world scenarios.