AI Conversation Quality Analyst & Context Researcher

Gramian Consulting Group; United States; À distance; USD 70 000 - 120 000; Plein temps

Résumé du poste

Gramian Consultancy seeks experienced Subject Matter Experts in psychology, social work, counseling, and related fields to support AI conversation evaluation research. You will review conversations between people and AI, assess contextual sufficiency, and identify missing opportunities for clarifications to improve outcomes.

The role requires 3–5 years of direct professional experience, strong analytical and interviewing skills, and the ability to distinguish essential information from

Qualifications

• 3–5 years of direct professional experience in one or more domains.
• Master’s degree in Social Work (MSW) or equivalent graduate-level qualification.
• LCSW, LICSW, LMSW, or equivalent credential or license.
• Experience in client assessment, case review, interviewing, counseling, or related social-work practice.

Responsabilités

• Review AI conversations involving interpersonal relationships, workplace situations, education, family matters, and other real-world decisions.
• Evaluate whether the AI gathered sufficient context before providing advice, recommendations, or proposed solutions.
• Identify missing information and suggest relevant follow-up questions that could improve the AI’s response.
• Assess whether additional context would materially change the recommendation or decision.
• Distinguish between load-bearing information that could change the outcome and non-essential or descriptive details.
• Conduct qualitative reviews using structured evaluation guidelines and document findings consistently.
• Identify missed opportunities for clarification, contextual understanding, and information gathering.
• Consider relevant personal, psychological, social, financial, practical, and organizational factors in evaluation.
• Collaborate with research teams to maintain consistent evaluation standards and high-quality assessments.
• Complete assigned tasks accurately within required project timelines.

Connaissances

Analytical skills

Interviewing skills

Formation

MSW (Master’s in Social Work)

LCSW/LICSW/LMSW

PhD or PsyD in related psychology field

Description du poste

Gramian Consultancy seeks experienced Subject Matter Experts in psychology, social work, counseling, and related fields to support AI conversation evaluation research. You will review conversations between people and AI, assess contextual sufficiency, and identify missing opportunities for clarifications to improve outcomes.

The role requires 3–5 years of direct professional experience, strong analytical and interviewing skills, and the ability to distinguish essential information from