Senior AIML Evaluation Lead, Data Science & Insights

Apple Inc.; Seattle, Northern (WA, KY); Hybrid; USD 226,000 - 382,000; Full time

Job summary

Apple Inc. in Seattle, WA seeks a Senior Manager of AIML Evaluation within Data Science & Insights. You will lead a team of data scientists focused on evaluation for Apple Intelligence and related features, balancing quality with privacy while guiding strategy.

You will drive hands-on evaluation, develop LLM-based autograders, partner with Siri AI and SWE teams, recruit and mentor staff, and report to senior leadership.

Qualifications

• 6+ years of experience in data science and machine learning evaluation, including 3+ years leading technical teams
• Advanced degree in a quantitative field such as Statistics, Computer Science, Machine Learning, or similar
• Demonstrated track record of running teams of 7+ data scientists and/or machine learning engineers
• Strong experience in human evaluation methodology for consumer-facing products at scale
• Hands-on experience building and deploying LLM-based autograders and rubrics, and using them to drive proactive improvements in models and agentic features
• Strong written and verbal communication skills, able to communicate effectively with engineers and senior leaders

Responsibilities

• Owning the evaluation roadmap for your area, translating the org's broader evaluation strategy into concrete methods and deliverables
• Leading a team of data scientists — recruiting, developing, and retaining strong technical talent across both disciplines
• Driving hands-on execution across human evaluation, and LLM-based autograders and rubrics, and ensuring those methods translate into measurable model and agentic feature improvements
• Partnering with Apple Intelligence, Siri AI, and other SWE product and engineering teams to embed evaluation into product development cycles and turn evaluation results into shipped quality gains.Representing your team's work to senior leadership across AIML and SWE

Skills

Data science

Machine learning evaluation

Team leadership

Communication

LLM autograders

Evaluation methodology

Education

Advanced degree in quantitative field

Tools

Logging infrastructure

Job description

Apple Inc. in Seattle, WA seeks a Senior Manager of AIML Evaluation within Data Science & Insights. You will lead a team of data scientists focused on evaluation for Apple Intelligence and related features, balancing quality with privacy while guiding strategy.

You will drive hands-on evaluation, develop LLM-based autograders, partner with Siri AI and SWE teams, recruit and mentor staff, and report to senior leadership.