Knowledge Expert — Human Communication & Context Elicitation

Verita Ai; Brasil; Remote; BRL 124,000 - 193,000; Full time

Benefits offered by this job

Fully remote

Job summary

Verita Partner is seeking Knowledge Expert — Human to review AI conversations and assess whether sufficient context was gathered before recommendations. You will provide structured feedback to improve AI reasoning and conversational quality, working across global contexts and adhering to detailed evaluation guidelines.

Successful candidates will have advanced degrees in social/clinical psychology or related fields, with 5+ years of advisory experience, and strong analytical, documentation, and

Qualifications

• Strong analytical thinking and qualitative evaluation skills.
• Excellent attention to detail and ability to apply guidelines.
• Comfort with spreadsheets and annotation/data labeling tools.
• Strong written communication and documentation skills.
• Ability to evaluate nuanced conversations objectively.

Responsibilities

• Review AI conversations involving real-world scenarios.
• Identify missing context and suggest follow-up questions.
• Evaluate if more information would change AI recommendations.
• Distinguish between critical and non-essential information.

Skills

Analytical thinking

Qualitative evaluation

Attention to detail

Written communication

Data labeling tools

Spreadsheets

Education

MSW with LCSW or equivalent licensure

MA/MS with LMFT/LCPC or equivalent

PhD or PsyD in Clinical/Counseling/Social/IO Psychology

MA or PhD in HCI, Communication, Anthropology, Sociology, or related field

5+ years advisory/consulting experience with credential

Tools

Annotation platforms

Data labeling tools

Job description

Verita Partner

Knowledge Expert — Human

We're looking for human communication experts to expand our global network of subject matter experts to support AI conversation evaluation research.

In this role, you'll review conversations between participants and AI models, evaluate whether sufficient context was gathered before recommendations were made, identify missed opportunities for clarification, and provide structured feedback that helps improve the quality, reasoning, and conversational abilities of next-generation AI systems.

COMPENSATION

Up to $28 per completed task (average task time: ~87.5 minutes)

Up to 40 hours per week

At least 4 hours of overlap with Pacific Time (PST)

Fully remote

WHAT WE'RE LOOKING FOR

We're seeking subject matter experts with one of the following qualifications:

• MSW with LCSW (or equivalent social work licensure)
• MA/MS with LMFT, LPC, LCPC, or equivalent counseling licensure
• PhD or PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology
• MA or PhD in Human-Computer Interaction (HCI), Communication, Anthropology, Sociology, Conflict Resolution, Qualitative Research, or a closely related field
• A relevant professional credential combined with 5+ years of direct advisory, coaching, consulting, mediation, or client-facing experience

Successful candidates will also demonstrate:

• Strong analytical thinking and qualitative evaluation skills
• Excellent attention to detail and the ability to consistently apply detailed evaluation guidelines
• Comfort working with spreadsheets, annotation platforms, or data labeling tools
• Strong written communication and documentation skills
• The ability to evaluate nuanced human conversations objectively and consistently
• Experience making evidence-based judgments across ambiguous or complex scenarios

PREFERRED QUALIFICATIONS

While not required, experience in any of the following is a plus:

• Conversation analysis or discourse analysis
• AI evaluation, RLHF, or human preference labeling
• Qualitative research coding or thematic analysis
• Coaching, mediation, or conflict resolution frameworks
• Human-computer interaction (HCI) or conversational UX research
• Developing evaluation rubrics, annotation guidelines, or quality assurance processes

KEY RESPONSIBILITIES

• Review AI conversations involving real-world interpersonal and everyday decision-making scenarios
• Identify missing context and recommend relevant follow-up questions
• Evaluate whether additional information would have changed the AI's recommendations
• Distinguish between critical ("load-bearing") and non-essential information
• Conduct qualitative reviews and document findings using structured evaluation guidelines