Engineering Manager, Model & Algorithm Evaluation & Quality, Sensing & Connectivity

Apple, Inc.; Cupertino (CA); On-site; USD 206,000 - 356,000; Full time

Job summary

Apple Inc. in Cupertino, California, is seeking an Engineering Manager to lead the Model & Algorithm Evaluation & Quality team within Sensing & Connectivity.

You will oversee evaluation of location context ML models and the quality engineering that ships these features across iOS/watchOS, partnering with hardware to software teams. You will define evaluation strategies, build automation and dashboards, and guide a team through research-to-production quality gates while driving end-to-end product

Qualifications

• BS, MS, or PhD in Computer Science / Electrical Engineering or equivalent.
• 5+ years of relevant industry experience.
• 2+ years leading and managing an engineering team.
• Experience evaluating AI/ML models: benchmarks and evaluation protocols.
• Proficient in designing AI-assisted workflows using GenAI.

Responsibilities

• Own the model evaluation strategy for ML models and algorithms, incl. benchmarks and data validation.
• Set direction for evaluating models and translate assessments into improvements.
• Lead automation, CI, analytics, and monitoring to qualify features across releases.
• Identify KPIs, build dashboards, and present results to reviews and execs.
• Drive bug resolution and coordinate with Apple and partner teams to maintain quality.
• Collaborate with hardware, software, PM, and cross-functional partners for end-to-end quality.
• Hire, coach, and grow the team with career development.

Skills

ML model evaluation

Benchmarks design

Statistical analysis

GenAI testing

CI automation

Education

BS/MS/PhD in CS/EE

Tools

Python

CI/CD tooling

Job description

Engineering Manager, Model & Algorithm Evaluation & Quality, Sensing & Connectivity

Cupertino, California, United States Software and Services

Join the Sensing and Connectivity - Location Context team that powers critical experiences in Apple products. Our team works on providing personalized insights from users' daily patterns through multimodal sensing and AI models. This team combines advanced machine learning, including integration, adaptation, and tuning of foundation models, with contextual sensing, bolstered by innovative study design, to derive user insights for Maps and Fitness applications, Journal — among many more. As the leader of this team, you will have the rare and rewarding opportunity to shape upcoming products that will delight and inspire our customers. You and your team will own the quality of cutting-edge location intelligence features powered by ML models across various operating systems, including iOS and watchOS. We develop science-backed designs of AI/ML models that capture the complex interplay of human health and behavior, providing valuable insights directly to our customers. We foster innovation and embrace new technology to enhance our creative capabilities. We are seeking a manager who pairs a working understanding of ML with a track record of building and growing teams that validate these models and the supporting software.If this is you, we would be delighted to hear from you.

Description

The Sensing and Connectivity team is looking for a manager to lead a talented group of engineers who evaluate the algorithms and AI models behind our location context features, and who also own the quality engineering that ships them: test automation, software testing, and continuous integration. We work in a fast-paced environment that depends on a tight relationship between evaluation and development. You'll evaluate probabilistic, on-device models, defining what "correct" means where ground truth is scarce and real-world behavior can't be fully simulated. In this role you will:

• Own the model evaluation strategy for our ML models and other algorithms, including benchmarks, evaluation protocols, and validation of training data, features, and labels, along with the quality strategy for the end-to-end experiences they power.
• Set the technical direction for how the team evaluates these models. That means challenging design and implementation, turning assessments of model outputs into prioritized algorithm improvements, and holding the team to the same rigor in its own analysis and conclusions.
• Lead the team in building the automation, continuous integration, analytics, and monitoring that qualify features, measure performance and system memory usage, and track quality across releases.
• Identify the KPIs that define project success, build the dashboards behind them, and represent the team's results in user study, code, and data reviews as well as to engineering and executive audiences.
• Drive bug resolution across the broader software engineering organization and with partner teams across Apple, escalating and negotiating as needed to hold the quality bar.
• Work closely with development, program management, and cross-functional partners, from upstream hardware to downstream apps, to drive excellent end-to-end quality aligned with release schedules.
• Set a vision for the team's future direction, identify new opportunities, and build stakeholder buy-in to pursue them.
• Hire, coach, mentor, and grow the team, building on individual strengths and creating meaningful career growth.

Minimum Qualifications

• BS, MS, or PhD in Computer Science / Electrical Engineering or equivalent
• 5+ years of relevant industry experience
• 2+ years leading and managing an engineering team, with a track record of growing engineers' skill sets and creating meaningful career growth
• Experience evaluating AI/ML models: crafting benchmarks and evaluation protocols, and performing statistical analysis
• Proficient in designing AI-assisted workflows, using GenAI to automate and accelerate testing, debugging, and metrics analysis

Preferred Qualifications

• Hands-on engineering background, with enough software development experience to set technical direction and critically evaluate the team's work
• Experience evaluating foundation models or LLMs, for example building eval harnesses, golden datasets, LLM-as-judge pipelines, or human-in-the-loop evaluation
• Experience with sensor, time-series, or on-device ML models, and with the data pipelines behind them
• Experience building or leading automation, test infrastructure, and CI systems
• Experience working at the intersection of hardware and software
• Ability to work in a dynamic environment with shifting priorities and schedules, with excellent analytical, problem-solving, and communication skills

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $206,200 and $356,400, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant

At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.

Learn about accessibility in Apple’s workplace

Learn about reasonable accommodations for job applicants

Apple accepts applications to this posting on an ongoing basis.