Multilingual AI Evaluation Lead

Apple Inc.; Cupertino, Northern (CA, KY); Hybrid; USD 176,000 - 312,000; Full time

Job summary

Apple is seeking an Evaluation Science Lead in Cupertino, CA to define and validate multilingual Globalization AI solutions across Apple Services. You will design statistically grounded evaluation frameworks, combining human judgment with automation, and collaborate with Engineering, AI Strategy, and Production to operationalize evaluation as a strategic capability.

The role requires hands-on execution, strong analytical thinking, and the ability to communicate complex findings clearly.

Qualifications

• 5+ years of experience in evaluation science or ML systems development with end-to-end evaluation ownership.
• Experience applying statistical methods, sampling, significance testing, and confidence intervals.
• Proficiency with R, Python, SQL for analysis and reproducibility.
• Strong written and verbal communication for technical/non-technical audiences.
• Ability to be onsite; this role is an in-person, onsite position.

Responsibilities

• Define long-term evaluation science strategy and roadmap for Globalization AI solutions across 50+ languages.
• Design robust statistical methodologies with power analysis and significance thresholds.
• Architect scalable evaluation workflows blending human annotation with automated systems.
• Expand evaluation criteria to include behavioral and user engagement signals.
• Translate evaluation data into actionable recommendations for Engineering and leadership.
• Build continuous performance monitoring and drift-detection systems.

Skills

Evaluation science

Statistics

R/Python/SQL

Communication

On-site work

Education

Masters/PhD in quantitative field

Job description

Apple is seeking an Evaluation Science Lead in Cupertino, CA to define and validate multilingual Globalization AI solutions across Apple Services. You will design statistically grounded evaluation frameworks, combining human judgment with automation, and collaborate with Engineering, AI Strategy, and Production to operationalize evaluation as a strategic capability.

The role requires hands-on execution, strong analytical thinking, and the ability to communicate complex findings clearly.