LLM Bias & Fairness Auditor

Globik AI; United States; Remote; USD 22,000 - 28,000; Full time

Job summary

Globik AI is seeking LLM Bias Detection Specialists to evaluate model outputs for demographic, cultural, and ideological bias. You will identify biased patterns across prompts and responses and document findings to support fairness improvements.

Responsibilities include reviewing outputs for bias, comparing paired prompts, classifying bias type, and tracking recurring patterns to inform model improvements. Ideal candidates have a background in social science linguistics or AI ethics and can

Qualifications

• Background in social science linguistics or AI ethics is a plus.
• Ability to evaluate content objectively across diverse perspectives.

Responsibilities

• Review model responses for demographic, cultural, or ideological bias.
• Compare outputs across paired prompts to surface disparities.
• Classify bias type and severity according to project rubric.
• Distinguish genuine bias from appropriately nuanced or factual responses.
• Document findings with specific examples and rationale.
• Track recurring bias patterns across model versions.
• Maintain consistent, objective judgment across evaluation sets.

Skills

Bias detection

Critical thinking

Job description

Globik AI is seeking LLM Bias Detection Specialists to evaluate model outputs for demographic, cultural, and ideological bias. You will identify biased patterns across prompts and responses and document findings to support fairness improvements.

Responsibilities include reviewing outputs for bias, comparing paired prompts, classifying bias type, and tracking recurring patterns to inform model improvements. Ideal candidates have a background in social science linguistics or AI ethics and can