Data Scientist

Apple Inc.; Sunnyvale (CA); On-site; USD 185,000 - 325,000; Full time

Benefits offered by this job

Stock programs

RSU awards

Employee stock purchase plan

Medical and dental coverage

Retirement benefits

Product discounts

Educational expense reimbursement

Relocation assistance

Discretionary bonuses

Job summary

Apple is hiring for a role focused on evaluating the quality of generative imaging features. You will design evaluation sets, run human annotation, and develop automated metrics including LLM-as-judge systems, translating findings into decision-ready signals for model development.

Responsibilities include owning the evaluation lifecycle end to end, maintaining golden sets, building labeling tools, and calibrating automated outputs against human ratings.

Qualifications

• MS degree with at least 5 years of industry experience.
• Experience designing and analyzing ML evaluations and experiments.
• Strong Python and SQL skills; ability to build evaluation pipelines.

Responsibilities

• Own the quality evaluation lifecycle end to end, from design to recommendations.
• Establish measurement foundation with golden and evaluation sets.
• Run human evaluation with guidelines and labeling tools; monitor annotator quality.
• Automate metrics and LLM-as-judge systems; calibrate against human labels.
• Produce decision-ready results with model-vs-model comparisons and analyses.
• Collaborate across ML, engineering, and design to define quality standards.

Skills

Python

SQL

Data science

ML evaluation

Statistics

Communication

Cross-functional collaboration

Adaptability

Education

MS

Tools

LLM-as-judge systems

LLMs

VLM

3D Gaussian splats

diffusion models

Job description

Apple is building evaluation capabilities to measure the quality of generative imaging features in ways that engineering and product teams can trust. In this role, you will design evaluation sets, run human annotation, develop automated metrics including LLM-as-judge systems, and convert the findings into decision-ready quality signals that guide model development and release decisions.

What you will do

• Own the quality evaluation lifecycle end to end, from evaluation set design through annotation, scoring, analysis, and recommendations that influence what engineering and product build next.
• Establish the measurement foundation by designing and maintaining golden sets and evaluation sets, analyzing data distributions to keep results representative, and ensuring known defects remain covered.
• Run human evaluation by writing and iterating annotation guidelines and label schemas, building or adapting lightweight labeling tools for image and video review, monitoring annotator quality, and resolving disagreements and ambiguity in guidelines.
• Automate repeatable work by developing automated metrics and LLM-as-judge systems, calibrating them against human labels, and tracking where automated outputs diverge.
• Make results decision-ready through model-vs-model comparisons with confidence intervals, significance testing, and breakdowns by hotspot, content type, and failure mode, then translate outputs into root-cause findings and prioritized recommendations.
• Partner across ML, engineering, and design to define quality standards and communicate evaluation results clearly to both technical and non-technical audiences.

Minimum qualifications

• Education: MS
• Experience: Minimum 5 years of relevant industry experience
• 5+ years of experience in data science, machine learning evaluation, algorithm analysis, or related technical disciplines
• Experience designing and analyzing evaluations and experiments for ML or generative model quality, including sampling design, significance testing, and confidence intervals
• Strong Python skills and comfort with SQL, with the ability to build and maintain evaluation pipelines and small tools
• Familiarity with AI-assisted analysis workflows, foundation models, agentic systems, or intelligent automation approaches for technical problem solving

Technologies you may work with

• Python, SQL
• LLM-as-judge systems, LLMs, VLM
• 3D Gaussian splats, diffusion models

Preferred qualifications

• Experience evaluating 3D Gaussian splats or diffusion models, or assessing perceptual quality
• Experience building LLM or VLM judges and validating them against human ratings
• Experience building web-based labeling or review tools
• Ability to run several work streams in parallel and prioritize them
• Proven cross-functional collaboration and the ability to learn new tools quickly
• Strong written and verbal communication, including explaining statistical tradeoffs to engineers and product partners

Location and compensation

• Location: Sunnyvale, CA (onsite)
• Salary: USD 184,700 - 324,800 per year

Benefits

• Discretionary employee stock programs (Apple shareholder opportunity)
• Discretionary restricted stock unit awards
• Employee Stock Purchase Plan (purchase Apple stock at a discount, if voluntarily participating)
• Comprehensive medical and dental coverage
• Retirement benefits
• Range of discounted products and free services
• Reimbursement for certain educational expenses, including tuition
• Discretionary bonuses or commission payments as well as relocation (may be eligible)
• Base pay range between $184,700 and $324,800 (depends on skills, qualifications, experience, and location)

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.