Director, AI Evaluation & Insights

Apple Inc.; Cupertino, Northern (CA, KY); Hybrid; USD 311,000 - 497,000; Full time

Benefits offered by this job

Medical and dental coverage

Retirement benefits

Stock purchase plan

Tuition reimbursement

Relocation assistance

Job summary

Apple Inc. in Cupertino is seeking a seasoned AIML leader to head Data Science and Insights for Evaluation across Apple Intelligence, Siri, and a broad SWE portfolio.

You will guide the evaluation strategy, lead a large team of data scientists and ML engineers, and drive measurable quality gains with LLM-based autograders and AB testing. You will collaborate with cross-functional teams to embed evaluation into product development and communicate with senior leadership to align on strategy and

Qualifications

• 10+ years in data science and ML evaluation, incl. 6+ years leading large technical teams.
• Advanced degree in a quantitative field such as Statistics, Computer Science, Machine Learning.
• Proven track record leading orgs of 50+ data scientists and/or ML engineers.
• Deep experience in human evaluation methodology, logging, and AB testing for consumer products.
• Hands-on experience building and deploying LLM-based autograders and rubrics.
• Strong written and verbal communication with engineers and senior leaders.

Responsibilities

• Set the evaluation strategy for Apple Intelligence, Siri and SWE features.
• Lead a large team of data scientists and ML engineers; recruit and develop talent.
• Drive methodology across evaluation, logging, AB testing, and autograders.
• Embed evaluation into product cycles and translate results into quality gains.
• Collaborate with AIML Evaluation platforms, Apple Foundation Models, MT, etc.
• Represent the team to executive leadership including SVPs.

Skills

Data science & ML evaluation

Leadership of large teams

Strong communication

LLM autograders

AB testing

Human evaluation methodology

Education

Advanced degree in Statistics/CS/ML

Tools

Logging infrastructure

Evaluation frameworks

Agentic systems tooling

Job description

Apple Inc. in Cupertino is seeking a seasoned AIML leader to head Data Science and Insights for Evaluation across Apple Intelligence, Siri, and a broad SWE portfolio.

You will guide the evaluation strategy, lead a large team of data scientists and ML engineers, and drive measurable quality gains with LLM-based autograders and AB testing. You will collaborate with cross-functional teams to embed evaluation into product development and communicate with senior leadership to align on strategy and