AI Conversation Quality Analyst | $24/hr Remote

Crossing Hurdles; Colombia; Remote; COP 87,864,000 - 125,140,000; Part time

Job summary

Crossing Hurdles is seeking a Text Situated Alignment Specialist for a remote contract assignment. The role involves reviewing AI conversations, identifying missing context, and recommending follow-up questions in real-world scenarios.

You will evaluate information relevance and document findings with structured guidelines. The ideal candidate has 3+ years in psychology or related advisory fields with hands-on experience in client assessment, interviewing, counseling, case review, and

Qualifications

• 3+ years in psychology, social work, counseling, qualitative research, HCI, or related advisory fields.
• Hands-on experience with client assessment, interviewing, counseling, case review, qualitative research, or user research.
• Experience with qualitative coding or reviewing client interactions preferred.

Responsibilities

• Review AI conversations involving real-world interpersonal and everyday decision-making scenarios.
• Identify missing context and recommend relevant follow-up questions.
• Evaluate whether additional information could have changed the AI's recommendations.
• Distinguish between critical information and non-essential details.
• Conduct qualitative reviews and document findings using structured guidelines.

Skills

Qualitative research

Interviewing

Counseling

User research

Conversation analysis

Client assessment

Case review

Decision support

Job description

Position: Text Situated Alignment Specialist

Type: Contractor Assignment

Compensation: $24 per hour

Location: Remote

Commitment: Part-time (20-40 hours/week), for 3 weeks

Role Responsibilities

• Review AI conversations involving real-world interpersonal and everyday decision-making scenarios.
• Identify missing context and recommend relevant follow-up questions.
• Evaluate whether additional information could have changed the AI s recommendations.
• Distinguish between critical, decision-relevant information and non-essential details.
• Conduct qualitative reviews and document findings using structured evaluation guidelines.

Requirements

• 3+ years of experience in psychology, social work, counseling, qualitative research, HCI, communication, conflict resolution, coaching, student services, organizational consulting, or related advisory fields.
• Hands-on experience with client assessment, interviewing, counseling, case review, qualitative research, user research, conversation analysis, or similar work.
• Experience identifying relevant context and determining which information is important for informed recommendations.
• Experience with qualitative coding, structured case review, or reviewing client interactions is preferred.