Arabic LLM Evaluation & Cultural Alignment Expert

Innodata; Dammam; On-site; SAR 149,000 - 225,000; Full time

Job summary

A leading technology firm is seeking linguistically and culturally aware professionals to evaluate and enhance multilingual prompt-response datasets for large language models. The role involves rubric design, translation evaluation, and prompt creation. Candidates should possess native proficiency in Arabic and a Master's degree, with a preference for those experienced in LLM evaluation and prompt engineering. This position offers a unique opportunity to contribute to the cultural accuracy of LLM outputs.

Qualifications

• Deep familiarity with cultural norms in the corresponding region.
• Experience in content moderation or linguistic QA preferred.
• Comfortable working in spreadsheets and evaluation templates.

Responsibilities

• Update rubric definitions with Arabic specific examples.
• Identify need for additional rubrics tailored to specific languages.
• Review prompts translated from English to Arabic for accuracy.
• Rate prompt-response pairs using standardized evaluation templates.
• Document problematic outputs with clear explanations.

Skills

Native proficiency in Arabic

Attention to detail

Cultural awareness

Experience in LLM evaluation

Education

Master’s degree in relevant stream

Tools

Spreadsheets

Evaluation templates

Job description

A leading technology firm is seeking linguistically and culturally aware professionals to evaluate and enhance multilingual prompt-response datasets for large language models. The role involves rubric design, translation evaluation, and prompt creation. Candidates should possess native proficiency in Arabic and a Master's degree, with a preference for those experienced in LLM evaluation and prompt engineering. This position offers a unique opportunity to contribute to the cultural accuracy of LLM outputs.