Sr. Machine Learning Engineer, ML Systems Evaluation Engineering

Apple Inc.; Cupertino (CA); On-site; USD 175,000 - 309,000; Full time

Benefits offered by this job

Medical & dental coverage

Retirement benefits

Employee stock programs

Tuition reimbursement

Bonus potential / relocation

Job summary

Apple Inc. seeks a Senior Machine Learning Engineer specializing in Conversational AI to deliver offline evaluation insights and drive model improvements while upholding Apple’s strict privacy standards.

You will curate high-quality evaluation datasets for state-of-the-art models, collaborating with cross-functional teams and contributing to the evolution of Siri and Apple Intelligence.

Qualifications

• 7+ years of professional experience applying ML to real-world problems, with scalable data solutions in natural language products.
• Proven experience managing large-scale datasets for ML training and/or evaluation.
• Excellent programming skills in Python.
• MS/PhD in Machine Learning, Computer Science, or equivalent field.

Responsibilities

• Leverage Large Language Models to automatically evaluate model changes and assess naturalness of conversations.
• Create adversarial scenarios with generative AI to anticipate edge cases for robust evaluation.
• Shape the next generation of Siri and Apple products through your datasets and insights.

Skills

Python

Machine Learning

Natural Language Processing

Education

MS/PhD in Machine Learning or Computer Science

Job description

Seattle, Washington, United States Machine Learning and AI

Join the team redefining what a deeply personal and integrated assistant can be. As part of the Siri organization, you will help shape one of the world's most widely used AI assistants, powered by our next-generation of Apple Intelligence, with capabilities like personal context understanding and on-screen awareness, built with privacy from the ground up. Your work will have direct, meaningful impact for users across iOS, iPadOS, macOS, watchOS, and visionOS. This is a rare opportunity to build at the intersection of cutting-edge AI and human-centered design, shipping technology that is centered around users and their needs. Join the SCALE (Statistical Coverage and Large-scale Evaluation) team at Apple and contribute to a highly accomplished group that evaluates Siri and AI/ML models at scale to delight and inspire our users globally. If you are excited by large-scale systems, rigorous statistical evaluation, natural language understanding, and shaping the future of AI, we want you here! You’ll do more than join something, you’ll add something!

Description

We are seeking a highly skilled Senior Machine Learning Engineer specializing in Conversational AI. Our goal is to deliver offline evaluation insights that drive model development and improve the end-user experience, all while upholding Apple's strict privacy standards. In this pivotal role, you will collaborate with cross-functional teams to curate and evolve high-quality evaluation datasets for state-of-the‑art models. With the advent of Apple Intelligence, you will tackle novel challenges in evaluating highly personalized user experiences.

Responsibilities

• Your key focus will be leveraging Large Language Models (LLMs) to automatically evaluate model changes (LLM-as-a-Judge) and assess the naturalness of digital assistant conversations.
• You will also harness generative AI to create adversarial scenarios that anticipate edge cases, enabling robust, forward‑looking evaluation.
• Your work, and the datasets you generate, will directly shape the next generation of Siri and Apple products.

Minimum Qualifications

• 7+ years of professional experience applying machine learning to real-world problems and crafting scalable data solutions, specifically in natural language products.
• Proven experience managing large-scale datasets for ML training and/or evaluation.
• Excellent programming skills in Python
• MS/PhD in Machine Learning, Computer Science, or equivalent experience in a related field

Preferred Qualifications

• The qualifications that will benefit a candidate to be successful in your role. Please list no more than 6-8.
• Deep domain knowledge in Conversational AI and a strong understanding of the end-to‑end ML product lifecycle.
• Expertise in defining and measuring evaluation coverage for Large Language Models (LLMs) and agentic systems.
• Track record of delivering large-scale, cross‑functional ML product or platform outcomes.
• Excellent problem‑solving, critical thinking, and communication skills to drive alignment across teams.
• Experience with systems engineering; in‑depth understanding of interdependencies of ML and SW components

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $175,000 and $308,500, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs.

Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan.

• Comprehensive medical and dental coverage
• Retirement benefits
• A range of discounted products and free services
• For formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition
• This role might be eligible for discretionary bonuses or commission payments as well as relocation

Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant

At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.

Learn about accessibility in Apple’s workplace

Learn about reasonable accommodations for job applicants

Apple accepts applications to this posting on an ongoing basis.