Senior Data Scientist - LLM Evaluation & Product Impact

Apple; Seattle (WA); On-site; USD 175,000 - 309,000; Full time

Benefits offered by this job

Medical and dental coverage

Retirement benefits

Discounted Apple products and services

Educational expense reimbursement

Relocation assistance

Apple stock purchase plan

Job summary

Apple is seeking a senior evaluation scientist to design rigorous methods for measuring and improving how products learn, search, and respond. You will work on-site in Seattle, WA, collaborating with multi-disciplinary teams to translate analytics into actionable product improvements for Siri and Apple Intelligence.

You will handle large datasets, apply advanced analytics, and explore prompt engineering and LLM-based judgments to drive quality and user experience.

Qualifications

• 5 years of relevant work experience.
• Advanced degree in a quantitative field such as Statistics, Operational Research, Bioinformatics, Economics, Psychology, Computer Science, Sociology, Mathematics, Physics, or similar.
• Proficiency in data science, machine learning, and analytics, including statistical data analysis.
• Experience crafting, conducting, analyzing, and interpreting experiments and investigations, with focus on data quality, evaluation, and risk assessment.
• Strong programming skills, including data querying with SQL and/or Spark and experience with a scripting language for data processing and development such as Python, R, or Scala.
• Ability to translate business questions into statistical approaches and arrive at answers using available data.
• Strong communication skills, with the ability to explain difficult technical topics (including causal topics) to data scientists, engineers, and business partners.

Responsibilities

• Research and develop evaluation methods to improve the quality of user-facing Apple products (for example, Siri and Apple Intelligence).
• Partner with evaluation and experimentation engineering teams to translate methodological advances into technologies that product engineering applies daily.
• Work with large, complex data sets and tackle difficult, non-routine analysis problems using advanced analytical methods.
• Apply techniques including prompt engineering and building LLMs as judges.
• Run analysis that covers data collection and quality control, requirements specification, processing, and presentations.
• Build and prototype analysis pipelines iteratively to deliver insights at scale.
• Develop deep understanding of product data structures and metrics, and advocate for changes needed to support product development.
• Collaborate closely with product engineering teams on core machine learning algorithms and user experience evaluations.
• Stay focused on creating outcomes through a passion for building outstanding products.

Skills

Data science

Machine learning

Analytics

Experiments

Programming

SQL

Spark

Python

R

Scala

Communication

Translating business questions to math

Education

Advanced degree in a quantitative field

Tools

SQL

Spark

Python

R

Scala

LLMs

Job description

Apple is seeking a senior evaluation scientist to design rigorous methods for measuring and improving how products learn, search, and respond. You will work on-site in Seattle, WA, collaborating with multi-disciplinary teams to translate analytics into actionable product improvements for Siri and Apple Intelligence.

You will handle large datasets, apply advanced analytics, and explore prompt engineering and LLM-based judgments to drive quality and user experience.