Senior Evaluation Scientist ML for User Experience

Apple; Seattle (WA); On-site; USD 142,000 - 263,000; Full time

Benefits offered by this job

Comprehensive medical and dental

Retirement benefits

Employee stock programs

Tuition reimbursement

Relocation assistance

Job summary

Apple is seeking a seasoned evaluation scientist to measure product quality across user-facing experiences. You will research evaluation methods for Siri and Apple Intelligence, partner with engineering teams to translate methods into technologies, and tackle data-driven problems using ML and advanced analytics.

You will work with large datasets, prototype scalable pipelines, and advocate for data-driven product improvements.

Qualifications

• Advanced degree in a quantitative field such as Statistics, OR, Bioinformatics, Economics, Psychology, CS, Sociology, Mathematics or Physics.
• 5+ years of relevant experience.
• Proven cross-functional collaboration ability.
• Experience leading projects with varying scope and depth.
• Experience addressing accuracy and variability in human annotation data.
• Proficiency in data science, ML, and analytics.
• Experience designing, conducting, analyzing experiments with emphasis on data quality and risk assessment.
• Strong programming skills in SQL and/or Spark and scripting languages like Python, R, or Scala.
• Ability to translate business questions into analytical approaches and apply statistics.

Responsibilities

• Research and develop evaluation methods to improve quality of Apple user facing products (e.g., Siri, Apple Intelligence).
• Partner with evaluation and experimentation teams to translate methods into product engineering technologies.
• Work with large datasets and tackle non-routine problems using advanced analytics, including prompt engineering and building LLMs as judges.
• Perform analysis across data collection, quality control, requirements, processing, and presentations.
• Build and prototype analysis pipelines to deliver Insights at scale.
• Develop deep knowledge of product data structures and advocate for changes to support product development.
• Collaborate with product engineering on core ML algorithms and user experience evaluations.

Skills

Data science

Machine learning

Analytics

SQL

Spark

Python

R

Scala

Education

Advanced quantitative degree

Tools

SQL

Spark

Python

R

Scala

Job description

Apple is seeking a seasoned evaluation scientist to measure product quality across user-facing experiences. You will research evaluation methods for Siri and Apple Intelligence, partner with engineering teams to translate methods into technologies, and tackle data-driven problems using ML and advanced analytics.

You will work with large datasets, prototype scalable pipelines, and advocate for data-driven product improvements.