Senior Multilingual AI Evaluation Scientist

Socket.dev; Seattle (WA); On-site; USD 150,000 - 230,000; Full time

Job summary

Apple seeks a highly skilled researcher to ensure AI features perform across languages and cultures. You will drive multilingual evaluation development from design to implementation, building scalable methods with measurement scientists and ML researchers.

You will publish novel findings while shipping practical evaluation tooling in Python across languages and scripts. You will shape evaluation methodology, test across dialects and cultures, and contribute to scalable pipelines that enable

Qualifications

• Advanced linguistics knowledge with fluency in multiple languages beyond English.
• Strong programming in Python for research tooling.
• Experience evaluating/shipping features across languages or locales.
• Ability to design rigorous benchmarks and evaluation protocols.

Skills

Linguistics

Python

Multilingual evaluation

Benchmark design

Statistical rigor

Cross-functional collaboration

Education

MS in Linguistics/Computational Linguistics/NLP

Tools

PyTorch

JAX

Job description

Apple seeks a highly skilled researcher to ensure AI features perform across languages and cultures. You will drive multilingual evaluation development from design to implementation, building scalable methods with measurement scientists and ML researchers.

You will publish novel findings while shipping practical evaluation tooling in Python across languages and scripts. You will shape evaluation methodology, test across dialects and cultures, and contribute to scalable pipelines that enable