Remote AI Conversation Quality Analyst (Contractor)

Crossing Hurdles; Colombia; Remote; COP 105,783,000 - 141,044,000; Full time

Job summary

Crossing Hurdles is seeking a Text Situated Alignment Specialist for a remote, contractor assignment. The role is full-time (40 hours/week) for three weeks at $24/hour. You will review AI conversations, identify missing context, and propose follow-up questions to improve recommendations.

You will assess relevance, document findings with structured guidelines, and collaborate with cross-functional teams. Requirements include 3+ years in psychology, counseling, qualitative research, or related

Qualifications

• 3+ years of experience in psychology, social work, counseling, qualitative research or related advisory fields.
• Hands-on experience with client assessment, interviewing, counseling, case review, qualitative research or user research.
• Experience with qualitative coding, structured case review, or reviewing client interactions is preferred.

Responsibilities

• Review AI conversations involving real-world interpersonal and everyday decision-making scenarios.
• Identify missing context and recommend relevant follow-up questions.
• Evaluate whether additional information could have changed the AI’s recommendations.
• Distinguish between critical, decision-relevant information and non-essential details.
• Conduct qualitative reviews and document findings using structured evaluation guidelines.

Skills

Qualitative analysis

Interviewing

Context identification

User research

Conflict resolution

Coaching

Education

PhD or Master’s in psychology / related field

Bachelor’s degree in a related field

Job description

Crossing Hurdles is seeking a Text Situated Alignment Specialist for a remote, contractor assignment. The role is full-time (40 hours/week) for three weeks at $24/hour. You will review AI conversations, identify missing context, and propose follow-up questions to improve recommendations.

You will assess relevance, document findings with structured guidelines, and collaborate with cross-functional teams. Requirements include 3+ years in psychology, counseling, qualitative research, or related