Sr. Machine Learning Engineer, ML Systems Evaluation Engineering

Socket.dev; Cupertino (CA); On-site; USD 180,000 - 260,000; Full time

Job summary

Apple seeks a Senior Machine Learning Engineer specializing in Conversational AI to advance offline evaluation and dataset curation for state-of-the-art models. You will work with cross-functional teams to improve end-user experiences while upholding Apple’s privacy standards.

You will contribute to highly personalized user experiences and collaborate on evaluating models at scale, supporting Siri across Apple platforms including iOS, iPadOS, macOS, watchOS, and visionOS.

Qualifications

• 7+ years of professional experience applying machine learning to real-world problems, especially in natural language products.
• Proven experience managing large-scale datasets for ML training and/or evaluation.
• Excellent programming skills in Python; MS/PhD in Machine Learning, Computer Science, or related field.

Skills

Python programming

Natural language processing

Large-scale data handling

ML model evaluation

Education

MS/PhD in Machine Learning or CS

Job description

Join the team redefining what a deeply personal and integrated assistant can be. As part of the Siri organization, you will help shape one of the world's most widely used AI assistants, powered by our next-generation of Apple Intelligence, with capabilities like personal context understanding and on-screen awareness, built with privacy from the ground up. Your work will have direct, meaningful impact for users across iOS, iPadOS, macOS, watchOS, and visionOS. This is a rare opportunity to build at the intersection of cutting-edge AI and human-centered design, shipping technology that is centered around users and their needs. Join the SCALE (Statistical Coverage and Large-scale Evaluation) team at Apple and contribute to a highly accomplished group that evaluates Siri and AI/ML models at scale to delight and inspire our users globally. If you are excited by large-scale systems, rigorous statistical evaluation, natural language understanding, and shaping the future of AI, we want you here! You’ll do more than join something, you’ll add something!

Description

We are seeking a highly skilled Senior Machine Learning Engineer specializing in Conversational AI. Our goal is to deliver offline evaluation insights that drive model development and improve the end-user experience, all while upholding Apple's strict privacy standards. In this pivotal role, you will collaborate with cross-functional teams to curate and evolve high-quality evaluation datasets for state-of-the-art models. With the advent of Apple Intelligence, you will tackle novel challenges in evaluating highly personalized user experiences.

Minimum Qualifications

• 7+ years of professional experience applying machine learning to real-world problems and crafting scalable data solutions, specifically in natural language products.
• Proven experience managing large-scale datasets for ML training and/or evaluation.
• Excellent programming skills in PythonMS/PhD in Machine Learning, Computer Science, or equivalent experience in a related field

Preferred Qualifications

The qualifications that will benefit a candidate to be successful in your role. Please list no more than 6-8.

• Deep domain knowledge in Conversational AI and a strong understanding of the end-to-end ML product lifecycle.
• Expertise in defining and measuring evaluation coverage for Large Language Models (LLMs) and agentic systems.
• Track record of delivering large-scale, cross-functional ML product or platform outcomes.
• Excellent problem-solving, critical thinking, and communication skills to drive alignment across teams.
• Experience with systems engineering; in-depth understanding of interdependencies of ML and SW components