Senior Multilingual AI Evaluation Scientist

Apple Inc.; Seattle (WA); On-site; USD 205,000 - 309,000; Full time

Benefits offered by this job

Relocation assistance

Educational reimbursement (tuition)

Stock programs eligibility

Employee stock purchase plan

Comprehensive medical and dental cover

Job summary

Apple Inc. in Seattle seeks a senior applied scientist to advance multilingual AI evaluation tooling across languages and cultures. You will design methods in Python and work with ML researchers, measurement scientists, and platform engineers.

This hands-on role emphasizes independent initiative, rigorous methodology, and publishing novel work while contributing to scalable evaluation across the world.

Qualifications

• MS in Linguistics, Computational Linguistics, NLP, Computer Science, or a related field — or equivalent research/work experience.
• Deep expertise in linguistics, with working fluency in the structure of multiple languages beyond English.
• Strong proficiency in Python.
• Solid understanding of LLMs and AI evaluation fundamentals, including how language models process and generate across languages.
• Demonstrated experience shipping or evaluating features across multiple languages or locales.
• Experience designing benchmarks, datasets, or human evaluation protocols, with attention to statistical rigor and reproducibility.
• Ability to drive initiatives independently and collaborate across a cross-functional, interdisciplinary team.
• Strong written and verbal communication skills.

Responsibilities

• Extend Apple’s AI evaluation methodology and tooling to new languages and locales, so our AI experiences are equally capable, accurate, and culturally appropriate — not just translated English.
• Design and validate evaluation methods, benchmarks, and metrics that capture language- and culture-specific phenomena: grammar, morphology, script, register, dialect, code-switching, and cultural norms.
• Build and curate high-quality multilingual datasets and human evaluation protocols, partnering with linguists and native-speaker annotators.
• Investigate how LLMs and agentic systems behave across languages, identifying systematic failure modes, capability gaps, and quality disparities between high- and low-resource languages.
• Partner with engineers to productionize your methods so they run reliably and at scale, implementing your own work in Python.
• Communicate findings clearly — translating results into actionable guidance for model and product teams, and publishing novel work where appropriate.

Skills

Strong proficiency in Python

Fluent in multiple languages beyond EN

Strong written and verbal comms

Education

MS in Linguistics/Computational Linguistics/NLP/CS or related

PhD in Linguistics/NLP (preferred)

Tools

PyTorch

JAX

Job description

Apple Inc. in Seattle seeks a senior applied scientist to advance multilingual AI evaluation tooling across languages and cultures. You will design methods in Python and work with ML researchers, measurement scientists, and platform engineers.

This hands-on role emphasizes independent initiative, rigorous methodology, and publishing novel work while contributing to scalable evaluation across the world.