Remote AI Conversation Quality Evaluator

Crossing Hurdles; Sweden; Remote; SEK 360,000 - 513,000; Full time

Job summary

Crossing Hurdles is seeking a Text Situated Alignment Specialist for a remote, contractor assignment. You will review AI conversations involving real-world interpersonal and everyday decision-making scenarios and identify missing context.

You will recommend follow-up questions and assess how additional information could have changed AI recommendations. Qualified candidates will have 3+ years in psychology, qualitative research, and related advisory fields, with hands-on experience in client

Qualifications

• 3+ years of experience in psychology, social work, counseling, qualitative research, HCI, communication, conflict resolution, coaching, student services, organizational consulting, or related advisory fields.
• Hands-on experience with client assessment, interviewing, counseling, case review, qualitative research, user research, conversation analysis, or similar work.
• Experience identifying relevant context and determining which information is important for informed recommendations.
• Experience with qualitative coding, structured case review, or reviewing client interactions is preferred.

Responsibilities

• Review AI conversations involving real-world interpersonal and everyday decision-making scenarios.
• Identify missing context and recommend relevant follow-up questions.
• Evaluate whether additional information could have changed the AI s recommendations.
• Distinguish between critical, decision-relevant information and non-essential details.
• Conduct qualitative reviews and document findings using structured evaluation guidelines.

Skills

Psychology

Counseling

Qualitative research

User research

Interviewing

Conflict resolution

Communication

Coaching

Organizational consulting

Decision making context

Job description

Crossing Hurdles is seeking a Text Situated Alignment Specialist for a remote, contractor assignment. You will review AI conversations involving real-world interpersonal and everyday decision-making scenarios and identify missing context.

You will recommend follow-up questions and assess how additional information could have changed AI recommendations. Qualified candidates will have 3+ years in psychology, qualitative research, and related advisory fields, with hands-on experience in client