Globalization AI Evaluation Lead

Apple, Inc.; Cupertino (CA); Presencial; USD 176.000 - 312.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Comprehensive medical and dental cover

Retirement benefits

Employee stock programs

Tuition reimbursement

Relocation assistance

Descripción de la vacante

Apple is seeking an Evaluation Science Lead in Cupertino to define how multilingual globalization AI solutions are measured and validated across 50+ languages and markets. Lead the design of statistically grounded evaluation frameworks and partner with Engineering, AI Strategy, and Production to operationalize evaluation as a strategic capability.

You will own the development of scalable workflows blending human annotation with automated systems, expand evaluation criteria beyond linguistic

Formación

• 5+ years in evaluation science, data science, or ML systems, with end-to-end scale.
• Statistical methods: sampling, significance testing, and confidence intervals.
• Measurement validity principles.
• Experience measuring annotator agreement and improving protocols.
• Experience designing evaluation frameworks used by ops teams.

Responsabilidades

• Define long-term evaluation science strategy and roadmap for Globalization AI across 50+ languages.
• Design robust statistical methodologies—power analysis, sampling, confidence intervals, thresholds.
• Architect scalable evaluation workflows blending human annotation with automated systems.
• Expand evaluation criteria to include behavior and engagement signals.
• Translate evaluation data into actionable recommendations for Engineering and leadership.
• Build continuous performance monitoring and drift-detection systems.
• Establish feedback loops with Quality Operations and Engineering to refine rubrics as models evolve.
• Serve as resident authority on multilingual AI evaluation and share best practices.

Conocimientos

Statistical analysis

Evaluation design

Communication

Onsite collaboration

Ambiguity tolerance

Educación

Master’s or PhD in Statistics / Computational Linguistics / CS

Herramientas

R

Python

SQL

Descripción del empleo

Apple is seeking an Evaluation Science Lead in Cupertino to define how multilingual globalization AI solutions are measured and validated across 50+ languages and markets. Lead the design of statistically grounded evaluation frameworks and partner with Engineering, AI Strategy, and Production to operationalize evaluation as a strategic capability.

You will own the development of scalable workflows blending human annotation with automated systems, expand evaluation criteria beyond linguistic