Arabic LLM Evaluation & Cultural Alignment Expert

Innodata; Al-Hofuf; On-site; SAR 120,000 - 150,000; Full time

Job summary

A leading data solutions company is seeking professionals to evaluate and enhance multilingual datasets for large language models. This role requires native Arabic proficiency and focuses on rubric design, translation evaluation, and cultural sensitivity in language model outputs. Candidates with a Master’s degree and experience in LLM evaluation are preferred, offering a chance to impact AI performance in cultural contexts.

Qualifications

• Native proficiency in Arabic and familiar with cultural norms.
• Experience in LLM evaluation, content moderation, or linguistic QA preferred.
• Strong attention to detail in language use and cultural references.
• Comfortable with spreadsheets and evaluation templates.
• Graduate degree required.

Responsibilities

• Update rubric definitions with Arabic examples for cultural relevance.
• Review translations and suggest edits for accuracy.
• Write prompts to test LLM cultural awareness.
• Rate prompt-response pairs and provide justifications.
• Document outputs with explanations of violations.

Skills

Native proficiency in Arabic

Attention to detail

Cultural awareness

Experience with LLM evaluation

Education

Master’s degree in relevant stream

Tools

Spreadsheets

Evaluation templates

Job description

A leading data solutions company is seeking professionals to evaluate and enhance multilingual datasets for large language models. This role requires native Arabic proficiency and focuses on rubric design, translation evaluation, and cultural sensitivity in language model outputs. Candidates with a Master’s degree and experience in LLM evaluation are preferred, offering a chance to impact AI performance in cultural contexts.