AI Quality & Evaluation Engineer - Creativity Apps

Apple, Inc.

California

On-site

USD 150,000 - 230,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Apple, Inc. Creativity Apps is seeking a Machine Learning Engineer focused on evaluating and ensuring the quality of ML models and AI features across our creativity applications.

You will define evaluation strategies, design metrics, and build datasets and infrastructure to support end-to-end quality from development to deployment. You will collaborate with ML engineering, infrastructure, product, and design teams to translate use cases into measurable quality criteria, develop scalable

Qualifications

  • 5+ years of industry experience in machine learning or software engineering, with a focus on ML/AI model evaluation and quality.
  • Experience with evaluation methodology for ML models, LLMs, and AI products or features.
  • Strong understanding of the ML development cycle, from data and training to evaluation, deployment, and monitoring.
  • Solid machine learning fundamentals and LLM knowledge, including agentic workflows, and you keep up with the latest developments in the field.
  • Track record of applying LLMs, or agentic workflows to ML evaluation and quality.
  • Experience in data curation, dataset creation, and dataset quality, including iterative improvement workflows that deliver high-quality datasets tailored to specific products.
  • Experience designing evaluation metrics based on the model, the product, and its use cases.
  • Experience driving end-to-end evaluation and quality for AI products.
  • Fluency in quality reporting, presenting quality data to both technical and non-technical audiences.
  • Strong communication skills and experience working with and driving cross-functional partners.

Responsibilities

  • Define evaluation strategy and metrics for ML models, LLMs, and AI features, tailored to the model, the product, and its use cases.
  • Curate and create evaluation datasets, measure and improve dataset quality, and run iterative improvement loops so that datasets stay representative of each product.
  • Design, build, maintain, and optimize evaluation infrastructure at scale, with reproducible runs, tracked baselines, and comparisons between model versions.
  • Apply ML, LLMs, and agentic workflows to the evaluation itself, including automated judging, test generation, and analysis, to make evaluation more efficient, more accurate, and more scalable.
  • Drive end-to-end evaluation and quality of AI features, from model checkpoints to integrated, shipping features, including triaging issues and driving them to resolution.
  • Report quality clearly, turning evaluation results into ship/no-ship risk and recommendations for both technical and non-technical audiences.
  • Partner with and drive cross-functional teams, comfortable with ambiguity and making educated, critical judgments.

Skills

ML model evaluation
Quality assurance
Cross-functional collaboration
Python
Swift

Education

Bachelor's degree in Computer Science, Data Science, Machine Learning, or related field

Tools

Python
Swift

Job description

Apple, Inc. Creativity Apps is seeking a Machine Learning Engineer focused on evaluating and ensuring the quality of ML models and AI features across our creativity applications.

You will define evaluation strategies, design metrics, and build datasets and infrastructure to support end-to-end quality from development to deployment. You will collaborate with ML engineering, infrastructure, product, and design teams to translate use cases into measurable quality criteria, develop scalable

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Evaluation & Quality Engineer – Creativity Apps
ML Evaluation & Quality Engineer – Creativity Apps

Apple, Inc. • San Diego (CA)

On-site
USD 142,000 - 263,000
Medical and dental coverage
Retirement benefits
Employee stock purchase plan
+2
ML Evaluation & Quality Engineer – Creativity Apps
ML Evaluation & Quality Engineer – Creativity Apps

Apple, Inc. • San Diego (CA)

On-site
USD 142,000 - 263,000
Machine Learning Engineer, Evaluation and Quality, Creativity Apps
Machine Learning Engineer, Evaluation and Quality, Creativity Apps

Apple, Inc. • California

On-site
USD 150,000 - 230,000
Machine Learning Engineer, Evaluation and Quality, Creativity Apps
Machine Learning Engineer, Evaluation and Quality, Creativity Apps

Apple, Inc. • San Diego (CA)

On-site
USD 142,000 - 263,000
Medical and dental coverage
Retirement benefits
Employee stock purchase plan
+2
Machine Learning Engineer, Evaluation and Quality, Creativity Apps
Machine Learning Engineer, Evaluation and Quality, Creativity Apps

Apple, Inc. • San Diego (CA)

On-site
USD 142,000 - 263,000
ML Evaluation Engineer - Vision & Multimodal Benchmarks
ML Evaluation Engineer - Vision & Multimodal Benchmarks

Apple Inc. • Sunnyvale (CA)

Hybrid
USD 150,000 - 278,000
Medical & Dental coverage
Employee stock programs
Relocation support
+1
Head of Evaluation & ML Quality
Head of Evaluation & ML Quality

Apple, Inc. • Cupertino (CA)

On-site
USD 180,000 - 260,000
Senior ML Evaluation Platform Engineer
Senior ML Evaluation Platform Engineer

Apple, Inc. • Seattle (WA)

On-site
USD 180,000 - 280,000
ML Engineer — Agentic AI for Creative Apps
ML Engineer — Agentic AI for Creative Apps

Apple Inc. • Cupertino (CA)

Hybrid
USD 150,000 - 278,000
Medical and dental coverage
Retirement benefits
Discounted products and services
+3
Gen AI Quality Scientist: Evaluation & Metrics
Gen AI Quality Scientist: Evaluation & Metrics

Apple, Inc. • Sunnyvale (CA)

On-site
USD 185,000 - 325,000
Stock programs
RSU awards
Employee stock purchase plan
+6