LLM Bias Detection Specialist

Globik AI; United States; Remoto; USD 22.000 - 28.000; Tempo pieno

Descrizione del lavoro

Globik AI is seeking LLM Bias Detection Specialists to evaluate model outputs for demographic, cultural, and ideological bias. You will identify biased patterns across prompts and responses and document findings to support fairness improvements.

Responsibilities include reviewing outputs for bias, comparing paired prompts, classifying bias type, and tracking recurring patterns to inform model improvements. Ideal candidates have a background in social science linguistics or AI ethics and can

Competenze

• Background in social science linguistics or AI ethics is a plus.
• Ability to evaluate content objectively across diverse perspectives.

Mansioni

• Review model responses for demographic, cultural, or ideological bias.
• Compare outputs across paired prompts to surface disparities.
• Classify bias type and severity according to project rubric.
• Distinguish genuine bias from appropriately nuanced or factual responses.
• Document findings with specific examples and rationale.
• Track recurring bias patterns across model versions.
• Maintain consistent, objective judgment across evaluation sets.

Conoscenze

Bias detection

Critical thinking

Descrizione del lavoro

Globik AI is seeking LLM Bias Detection Specialists to evaluate model outputs for demographic, cultural, and ideological bias. You will identify biased patterns across prompts and responses and document findings to support fairness improvements.

Responsibilities

• Review model responses for demographic, cultural, or ideological bias.
• Compare outputs across paired or matched prompts to surface disparities.
• Classify bias type and severity according to project rubric.
• Distinguish genuine bias from appropriately nuanced or factual responses.
• Document findings with specific examples and rationale.
• Track recurring bias patterns across model versions.
• Maintain consistent, objective judgment across evaluation sets.

Qualifications

• Background in social science linguistics or AI ethics is a plus.
• Ability to evaluate content objectively across diverse perspectives.

Pay

$16–$20/task

Apply by 2026-12-10.