Sr Data Scientist, Evaluation

Apple; Cupertino (CA); On-site; USD 150,000 - 278,000; Full time

Benefits offered by this job

Medical and dental coverage

Retirement benefits

Employee stock plans

Bonuses or commissions (if eligible)

Relocation (if eligible)

Discounted products and services

Educational expense reimbursement

Job summary

Apple’s Evaluation team focuses on measurable product impact, helping improve Siri and Apple Intelligence. In this role, you’ll develop evaluation methods that translate into everyday technology for product engineering, using advanced analytics on large datasets and LLM-based judging to support better decisions across Apple products.

Location: Cupertino, CA onsite. Base pay range USD 150,400 to 277,600 per year as part of total compensation.

Qualifications

• Advanced degree in a quantitative field such as Statistics, OR, Bioinformatics, Economics, CS or related.
• Proficiency in data science, machine learning, analytics and statistical analysis.
• Experience planning, running and interpreting experiments focused on data quality, evaluation and risk.
• Strong programming skills with SQL/Spark and Python/R/Scala or similar.
• Ability to translate business questions into data-driven analysis.
• Clear communication to data scientists, engineers and business partners on complex topics.

Responsibilities

• Research and develop evaluation methods to improve the quality of Apple user facing products, including Siri and Apple Intelligence.
• Partner with evaluation and experimentation teams to productionize methodologies for product engineering use.
• Work with large data sets to support accurate evaluation and insight generation.
• Solve non-routine analysis problems using advanced analytical methods, including prompt engineering and using LLMs as judges.
• Lead analysis covering data collection and quality control, requirements, processing and presentations.
• Prototype analysis pipelines iteratively to deliver scalable insights.
• Develop knowledge of product data structures and metrics, advocating for changes in product development.
• Collaborate with product engineering on core ML algorithms and user experience evaluations.

Skills

Data science, ML, analytics

Strong communication

Learn new technologies

Education

Advanced degree in a quantitative field

Tools

SQL

Spark

Python

R

Scala

LLMs

Prompt engineering

Job description

Apple’s Evaluation team focuses on measurable product impact, helping improve the quality of Apple user facing experiences such as Siri and Apple Intelligence. In this role, you’ll develop and apply evaluation methods that translate into everyday technology for product engineering, using advanced analytics on large datasets and LLM-based judging to support better decisions across Apple products.

Location: Cupertino, CA (onsite)

Compensation: Base pay range is USD 150,400 to 277,600 per year. Base pay is one part of Apple’s total compensation package and is determined within a range.

What you’ll do

• Research and develop evaluation methods to improve the quality of Apple user facing products, including Siri and Apple Intelligence.
• Partner with evaluation and experimentation engineering teams to productionize your methodological developments for product engineering use.
• Work with large, complex data sets to support accurate evaluation and insight generation.
• Solve difficult, non-routine analysis problems using advanced analytical methods, including prompt engineering and building LLMs as judges.
• Lead analysis that includes data collection and quality control, requirements specification, processing, and presentations.
• Build and prototype analysis pipelines iteratively to deliver insights at scale.
• Develop deep knowledge of product data structures and metrics, advocating for changes where needed for product development.
• Collaborate closely with product engineering on core machine learning algorithms and user experience evaluations.

What you bring

• An advanced degree in a quantitative field such as Statistics, Operational Research, Bioinformatics, Economics, Psychology, Computer Science, Sociology, Mathematics, Physics, or a similar quantitative discipline.
• Proficiency in data science, machine learning, and analytics, including statistical data analysis.
• Experience crafting, conducting, analyzing, and interpreting experiments and investigations, particularly around data quality, evaluation, and risk assessment.
• Strong programming skills, including data querying (such as SQL and/or Spark) and experience with a scripting language for data processing and development (such as Python, R, or Scala).
• Experience translating business questions into analysis using statistical techniques with available data.
• Strong communication skills, including the ability to explain difficult technical topics, especially causal concepts, to data scientists, engineers, and business partners.

Tools and technologies

SQL, Spark, Python, R, Scala, LLMs, prompt engineering

Benefits

• Comprehensive medical and dental coverage
• Retirement benefits
• A range of discounted products and free services
• Reimbursement for certain educational expenses (including tuition) for formal education related to advancing your career at Apple
• Discretionary employee stock programs, including eligibility for discretionary restricted stock unit awards and discounted stock purchase through the Employee Stock Purchase Plan (if you voluntarily participate)
• Discretionary bonuses or commission payments (if eligible)
• Relocation (if eligible)

Preferred qualifications

• Proven ability to collaborate effectively across functions and work well in a team.
• Experience managing projects across a range of sizes and scopes, including knowing when to dive deep.
• Experience with methods that address accuracy and variability in human annotation data.
• Ability to learn new technologies and skills as working requirements change.