AI Conversation Quality & Context Evaluation Specialist

Gramian Consulting; Irlanda; Presencial; EUR 80 000 - 120 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Resumo da oferta

Gramian Consulting is seeking experienced Subject Matter Experts to support AI conversation evaluation research. You will review conversations between people and AI models, identify missing context, and provide structured feedback to improve conversational quality.

The ideal candidate has 3–5 years of relevant experience, strong analytical skills, and can distinguish information that could materially change a recommendation.

Qualificações

• Licensed Social Work professional required.
• MSW or equivalent graduate qualification.
• LCSW/LICSW/LMSW or equivalent license.
• Experience in client assessment, case review, interviewing, counseling, or related social-work practice.
• PhD or PsyD in Clinical, Counseling, Social, or IO Psychology.
• Experience in qualitative research, interviews, user research, or conversation analysis.
• At least 5 years of direct advisory or client-facing experience.
• Experience in coaching, mediation, student services, organizational consulting, or related work.
• Ability to gather context and provide informed recommendations.

Responsabilidades

• Review AI conversations involving real-world interpersonal situations and daily decision-making.
• Identify missing context and recommend follow-up questions to improve AI responses.
• Evaluate whether gathering additional information would change an AI recommendation.
• Differentiate between essential load-bearing information and non-critical details.
• Conduct qualitative reviews and document findings with structured guidelines.
• Assess conversations for relevant personal, psychological, social, financial and organizational factors.
• Identify opportunities for clarification and deeper information gathering.
• Review conversations about relationships, work, education, family, wellbeing, planning, and constraints.
• Collaborate with research teams to ensure consistent evidence-based assessments.
• Maintain high accuracy, clarity, and timely delivery of findings.

Conhecimentos

Analytical skills

Structured feedback

Qualitative reasoning

Communication

Context gathering

Decision analysis

Collaboration

Adaptability

Formação académica

MSW

LCSW/LICSW/LMSW license

PhD or PsyD in Psychology

LMFT / LPC / LCPC license

MA/PhD in HCI/Communication/Anthropology/Sociology/Qualitative Research

IO Psychology degree/experience

Descrição da oferta de emprego

Gramian Consulting is seeking experienced Subject Matter Experts to support AI conversation evaluation research. You will review conversations between people and AI models, identify missing context, and provide structured feedback to improve conversational quality.

The ideal candidate has 3–5 years of relevant experience, strong analytical skills, and can distinguish information that could materially change a recommendation.