ML Quality & Evaluation Engineer, Creativity Apps

Apple; United States; On-site; USD 140,000 - 190,000; Full time

Job summary

Apple’s Creativity Apps team seeks a Machine Learning Engineer focused on the evaluation and quality of ML models and AI features across creativity applications. You will define how we measure ship readiness, design evaluation strategies and metrics, and build the datasets and infrastructure behind them to drive end-to-end quality from development to customer delivery.

In this role you will collaborate with ML engineering, infrastructure, product, and design to translate models and use cases

Qualifications

• 5+ years of industry experience in ML or software engineering, focusing on ML/AI model evaluation and quality.
• Experience with evaluation methodology for ML models, LLMs, and AI products or features.
• Strong understanding of the ML development cycle from data and training to evaluation, deployment, and monitoring.
• Proficiency in Python and/or Swift or comparable languages.

Responsibilities

• Define evaluation strategy and metrics for ML models, LLMs, and AI features, tailored to the model, product, and use cases.
• Curate and create evaluation datasets; measure and improve dataset quality.
• Design, build, maintain, and optimize evaluation infrastructure at scale with reproducible runs and baselines.
• Apply ML/LLMs and agentic workflows to evaluation to improve efficiency and accuracy.
• Drive end-to-end evaluation and quality of AI features from model checkpoints to shipping features.
• Report quality clearly; translate evaluation results into ship/no-ship recommendations for technical and non-technical audiences.
• Partner with cross-functional teams and navigate ambiguity with informed judgments.

Skills

ML evaluation

Software engineering

Data curation

Dataset creation

Cross-functional collaboration

Python

Swift

Communication

Experimentation

Model evaluation

Education

Bachelor's degree in Computer Science or related field

Tools

Python

Swift

Job description

Apple’s Creativity Apps team seeks a Machine Learning Engineer focused on the evaluation and quality of ML models and AI features across creativity applications. You will define how we measure ship readiness, design evaluation strategies and metrics, and build the datasets and infrastructure behind them to drive end-to-end quality from development to customer delivery.

In this role you will collaborate with ML engineering, infrastructure, product, and design to translate models and use cases