AI Conversation Context & Quality Reviewer

Turing; United States; Remote; USD 70,000 - 110,000; Full time

Job summary

Turing is seeking Subject Matter Experts to review AI conversations and assess context before recommendations. You will identify missing information, suggest follow-up questions, and evaluate whether additional data would have altered AI guidance.

Strong backgrounds in social work, counseling, psychology, or qualitative research are required, with 3–5 years of direct practice. This role involves collaboration with research teams and a focus on high-quality assessments.

Qualifications

• 3–5 years of direct practice-relevant qualifications and professional experience in at least one of the areas listed.
• MSW/License credentials and clinical/counseling experience.
• Qualitative research or advisory background across related disciplines.

Responsibilities

• Review AI conversations involving real-world interpersonal and everyday decision-making scenarios.
• Identify missing context and recommend relevant follow-up questions.
• Evaluate whether additional information would have changed the AI's recommendations.
• Distinguish between critical (load-bearing) and non-essential information.
• Conduct qualitative reviews and document findings using structured evaluation guidelines.
• Collaborate with research teams to ensure consistent, high-quality assessments.

Education

MSW or equivalent graduate-level qualification in Social Work

LCSW, LICSW, LMSW, or equivalent social work license/credential

Experience with client assessment, case review, interviewing, counseling, or related social-work practice

MA/MS with LMFT, LPC, LCPC, or equivalent counseling/therapy license or credential

PhD/PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology

Experience with counseling, therapy, psychological assessment, interviewing, case review

MA/PhD or equivalent advanced expertise in HCI, Communication, Anthropology, Sociology, Qualitative Research, or related discipline

Experience conducting qualitative research, interviews, user research, conversation analysis

Qualitative Research, HCI Research, UX/User Research, Communication Research, Anthropology, Sociology

Relevant professional qualification, credential, or demonstrated subject-matter expertise in advisory fields

Significant direct experience in advisory, client-facing, coaching, mediation, student advising/services

Experience gathering context, understanding individual or organizational needs, and providing informed recommendations

Job description

Turing is seeking Subject Matter Experts to review AI conversations and assess context before recommendations. You will identify missing information, suggest follow-up questions, and evaluate whether additional data would have altered AI guidance.

Strong backgrounds in social work, counseling, psychology, or qualitative research are required, with 3–5 years of direct practice. This role involves collaboration with research teams and a focus on high-quality assessments.