AIML - Sr Data Scientist, Evaluation

Apple, Inc.

Cupertino (CA)

On-site

USD 185,000 - 325,000

Full time

17 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical and dental coverage
Stock program eligibility
Tuition reimbursement
Discretionary bonuses
Relocation assistance
Retirement benefits

Job summary

Apple, Inc. in Cupertino, California seeks a machine learning and AI evaluation specialist to influence product decisions at scale.

You will research evaluation methods for user facing products like Siri and Apple Intelligence, partnering with engineering to translate findings into production-ready tools and metrics. You will work with large data sets, design and run experiments, and apply advanced analytics and prompt engineering.

Qualifications

  • Advanced degree in a quantitative field such as Statistics, OR, Economics, CS, or Mathematics.
  • Experience with data quality, evaluation and risk assessment and statistical analysis.
  • Strong programming skills in SQL/Spark and Python/R/Scala for data processing.
  • Ability to translate business questions into measurable analyses and explain results.

Responsibilities

  • Research and develop evaluation methods to improve quality of Apple user facing products.
  • Work with evaluation/experimentation teams to translate methods into usable tech.
  • Handle large data sets and build pipelines for scalable insights.
  • Partner with product engineering on ML algorithms and user experience evaluations.

Skills

Data analysis
Experiment design
SQL/Spark
Python
R
Scala
Communication skills

Education

Advanced degree in quantitative field

Tools

SQL
Spark
Python
R
Scala

Job description

Cupertino, California, United States Machine Learning and AI

Do you get excited by driving product impact via measurement and evaluation, for products and services used by hundreds of millions of people globally?Within the evaluation organization, the mission of Data Science and Insights team is to guide product development, decisions and directions through principled evaluation and rigorous use of data. You will partner with various engineering teams to improve search quality and guide feature development with data, to deliver amazing search experiences across iPhone, iPad, HomePod, Mac, Watch, tv, across dozens of languages.

Description

Research and develop evaluation methods to improve the quality of Apple user facing products, such as Siri and Apple Intelligence. Work with evaluation/experimentation engineering teams to get your methodological developments translated into technologies that product engineering will use every day. Work with large, complex data sets. Solve difficult, non-routine analysis problems, applying advanced analytical methods as needed, including prompt engineering and building LLMs as judges. Conduct analysis that includes data collection and quality control, requirements specification, processing and presentations. Build and prototype analysis pipelines iteratively to provide insights at scale. Develop comprehensive knowledge of product data structures and metrics, advocating for changes where needed for product development. Partner closely with product engineering teams on core machine learning algorithms and user experience evaluations. You should be passionate about building outstanding products. This position involves a wide variety of skills and innovation.

Minimum Qualifications
  • Advanced degree in a quantitative field such as Statistics, Operational Research, Bioinformatics, Economics, Psychology, Computer Science, Sociology, Mathematics, Physics, or similar quantitative field.
  • Proficiency in data science, machine learning, and analytics, including statistical data analysis. Experience crafting, conducting, analyzing, and interpreting experiments and investigations, especially on data quality, evaluation and risk assessment.
  • Strong programming skills, including data-querying skills (SQL and/or Spark, etc.) and experience with a scripting language for data processing and development (e.g., Python, R, or Scala).
  • Experience articulating and translating business questions and using statistical techniques to arrive at an answer using available data. Strong communication skills and the ability to naturally explain difficult technical topics (especially causal topics) to everyone from data scientists to engineers to business partners.
Preferred Qualifications
  • Proven ability to collaborate effectively across functions and work well within a team.
  • Capable of driving projects of varying sizes and scopes - some will take months and some weeks — and you will need to know when to dive deep.
  • Worked with methods that address accuracy and variability in human annotation data.
  • Ability to learn new technology and skills to accommodate changing working requirements.

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $184,700 and $324,800, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

  • Comprehensive medical and dental coverage
  • retirement benefits
  • a range of discounted products and free services
  • reimbursement for certain educational expenses — including tuition
  • discretionary bonuses or commission payments
  • relocation

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant

At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.

Learn about accessibility in Apple’s workplace

Learn about reasonable accommodations for job applicants

Apple accepts applications to this posting on an ongoing basis.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AIML - Data Scientist, Evaluation
AIML - Data Scientist, Evaluation

Apple, Inc. • Cupertino (CA)

On-site
USD 150,000 - 278,000
Stock programs
Medical and dental coverage
Retirement benefits
+4
AIML - Data Scientist, Evaluation
AIML - Data Scientist, Evaluation

Apple, Inc. • Cupertino (CA)

On-site
USD 147,400 - 272,100
Employee stock programs
Comprehensive medical coverage
Retirement benefits
+1
Sr Data Scientist, Evaluation
Sr Data Scientist, Evaluation

Apple, Inc. • Cupertino (CA)

On-site
USD 150,000 - 278,000
Medical and dental coverage
Retirement benefits
Employee stock plans
+4
Sr Engineering Program Manager, Apple Intelligence Evaluations
Sr Engineering Program Manager, Apple Intelligence Evaluations

Apple Inc. • Cupertino (CA)

On-site
USD 145,000 - 264,000
Research Engineer / Scientist
Research Engineer / Scientist

Apple, Inc. • Cupertino (CA)

On-site
USD 216,000 - 325,000
Stock plan
Relocation assistance
Education reimbursement
AIML - Sr Software Engineer - AI, Evaluation
AIML - Sr Software Engineer - AI, Evaluation

Apple, Inc. • Cupertino (CA)

On-site
USD 150,000 - 278,000
Comprehensive medical and dental
Retirement benefits
Employee stock programs
+2
Senior Data Scientist for NLP & LLM Analytics
Senior Data Scientist for NLP & LLM Analytics

Apple Inc. • Cupertino (CA)

Hybrid
USD 150,000 - 278,000
Engineering Program Manager, Siri Evaluation
Engineering Program Manager, Siri Evaluation

Apple, Inc. • Cupertino (CA)

On-site
USD 145,000 - 264,000
Comprehensive medical and dental
Employee stock programs
Relocation assistance
Sr Engineering Program Manager, Apple Intelligence Evaluations
Sr Engineering Program Manager, Apple Intelligence Evaluations

Apple, Inc. • Cupertino (CA)

On-site
USD 145,000 - 264,000
Sr. Machine Learning Engineer, ML Systems Evaluation Engineering
Sr. Machine Learning Engineer, ML Systems Evaluation Engineering

Apple, Inc. • Seattle (WA)

On-site
USD 175,000 - 309,000
Stock awards
Employee stock purchase plan
Education reimbursement
+1