AI Conversation Quality Analyst & Qualitative Researcher

Gramian Consulting; Sweden; On-site; SEK 900,000 - 1,200,000; Full time

Job summary

Gramian Consultancy is seeking experienced Subject Matter Experts in psychology, social work, counseling, qualitative research, HCI, and related advisory fields to support AI conversation evaluation research.

You will review conversations between people and AI models, assess whether sufficient context was gathered before recommendations were made, and provide structured feedback to improve conversational quality.

Qualifications

• Licensed Social Work credentials (LCSW/LISW/LMSW or equivalent)
• Experience in client assessment, case review, interviewing, or counseling
• At least 5 years of direct advisory or client-facing experience

Responsibilities

• Review AI conversations involving real-world interpersonal situations.
• Identify missing context and recommend follow-up questions.
• Evaluate whether additional information would change recommendations.
• Distinguish load-bearing information from descriptive details.
• Document findings using structured evaluation guidelines.
• Assess whether conversations consider personal, psychological, social, financial, and organizational factors.
• Identify missed opportunities for clarification and deeper understanding.
• Review conversations about relationships, work, education, family, wellbeing, planning, and resources.
• Collaborate with research teams to ensure evidence-based assessments.
• Maintain high standards of accuracy and meet project deadlines.

Skills

Analytical skills

Context awareness

Client advisory experience

Structured feedback

Education

Master's degree in Social Work (MSW) or equivalent

PhD or PsyD in Clinical/Counseling/SIOP psychology

MA/PhD in Human-Computer Interaction or Qualitative Research

Job description

Gramian Consultancy is seeking experienced Subject Matter Experts in psychology, social work, counseling, qualitative research, HCI, and related advisory fields to support AI conversation evaluation research.

You will review conversations between people and AI models, assess whether sufficient context was gathered before recommendations were made, and provide structured feedback to improve conversational quality.