Arabic LLM Evaluation & Cultural Alignment Expert

Innodata; Medina Province; On-site; SAR 120,000 - 150,000; Full time

Job summary

A leading technology company in Saudi Arabia seeks professionals to evaluate and enhance multilingual prompt-response datasets for LLMs. This role requires native Arabic proficiency and cultural awareness to ensure that language models respond accurately. Key responsibilities include updating rubrics, reviewing translations, and documenting outputs. Preferred qualifications include experience in linguistic QA and familiarity with LLM platforms like ChatGPT. A Master's degree is required.

Qualifications

• Native proficiency in Arabic and familiarity with cultural norms.
• Experience in LLM evaluation, content moderation, or linguistic QA preferred.
• Strong attention to detail in language use and cultural references.

Responsibilities

• Update rubric definitions for cultural relevance.
• Review and revise translations from English to Arabic.
• Document outputs and annotate cultural insensitivities.

Skills

Native proficiency in Arabic

Attention to detail

Cultural awareness

Experience in LLM evaluation

Education

Master’s degree in relevant field

Tools

Spreadsheets

LLM platforms like ChatGPT

Job description

A leading technology company in Saudi Arabia seeks professionals to evaluate and enhance multilingual prompt-response datasets for LLMs. This role requires native Arabic proficiency and cultural awareness to ensure that language models respond accurately. Key responsibilities include updating rubrics, reviewing translations, and documenting outputs. Preferred qualifications include experience in linguistic QA and familiarity with LLM platforms like ChatGPT. A Master's degree is required.