Software Engineering Manager - Siri Evaluation, Test Development Tooling

Apple Inc.; Cupertino (CA); On-site; USD 237,600 - 356,400; Full time

Benefits offered by this job

Stock programs

Discretionary bonuses

Relocation

Comprehensive medical and dental

Tuition reimbursement

Job summary

Apple Inc. in Cupertino, CA is seeking an experienced Software Engineering Manager for Siri Evaluation and Test Development Tooling. You will lead a team building AI agent-based scenario authoring tools, set technical direction, and own end-to-end evaluation workflows—driving quality and scalability across Apple’s Siri architecture.

The role requires hands-on leadership, mentoring engineers, and collaboration with cross-functional partners to ship robust evaluation platforms and dashboards.

Qualifications

• 5+ years of production software development experience (Swift, Python, Java, or Go).
• 3+ years of engineering management experience.
• Strong technical leadership and ability to set architectural direction.

Responsibilities

• Lead and grow a team of engineers building AI agent-based scenario tooling.
• Set the team's technical direction and roadmap.
• Own systems that generate and manage evaluation scenarios end-to-end.
• Drive coverage traceability and gap analysis to map product capabilities to scenarios.

Skills

Swift

Python

Go

Engineering management

CI/CD

Tools

XCTest

REST/gRPC

Docker/Kubernetes

Job description

Software Engineering Manager - Siri Evaluation, Test Development Tooling

Cupertino, California, United States Machine Learning and AI

Siri's quality signal drives every model and product decision before a release ships, and that signal is only as good as the tests and scenarios behind it. The Test Development Tooling team, part of the Siri's Agentic Evaluation Engineering organization, is reimagining how those scenarios are created and maintained. We build tools and AI-powered automation that free our engineers to focus on the quality and strategy of evaluation rather than the manual work of authoring tests. We're looking for an inspiring, hands-on engineering leader to run this team and set its technical direction.

Description

The ideal candidate is technically strong player-coach that will provide technical direction for the team. Responsibilities include leading a team of high-performing engineers, setting technical direction, driving development from requirements to delivery, collaborating with partner teams across Apple, and mentoring engineers to reach their best potential.

Responsibilities

• Lead and grow a team of engineers building AI agent-based scenario authoring and selection tools.


• Set the team's technical direction and roadmap.


• Own the systems that generate, validate, ground, and manage evaluation scenarios through their full lifecycle.


• Drive coverage traceability and gap analysis so that every product capability maps to a scenario, and every gap is visible.


• Deliver and evolve coverage, reliability, and health dashboards and release-readiness signals that leadership relies on for ship decisions.


• Collaborate across the evaluation organization and Apple to integrate and ground scenarios end to end at scale.


• Partner with QE engineers, feature teams, architecture leads, and design stakeholders to set and hold a defensible quality bar.


• Recruit, mentor, and develop engineers, including senior ICs, with a focus on engineering rigor, technical depth, and clear ownership.


• Operate effectively in ambiguity, reshaping team scope as the evaluation platform and the underlying Siri architecture evolve.

Minimum Qualifications

• 5+ years of experience developing production software (e.g., Swift, Python, Java, or Go).


• 3+ years of engineering management experience.


• Strong technical leadership and the ability to set architectural direction and inspire a team.


• Experience with test infrastructure, CI/CD, or evaluation/ML platforms.


• Proactive and self-motivated, with demonstrated creative and critical-thinking abilities.

Preferred Qualifications

• Experience building or leading teams that apply LLMs / AI agents to real engineering workflows (e.g., automated test generation, code generation, or agentic pipelines with human-in-the-loop review).


• Depth in one or more of: distributed systems and backend services (REST/gRPC), cloud infrastructure (Docker/Kubernetes), data platforms, or large-scale test and release infrastructure.


• Familiarity with Apple's testing frameworks (XCTest and related) and with ML/LLM evaluation concepts.


• Demonstrated cross-functional leadership and the ability to drive coverage and quality decisions with senior stakeholders.


• Experience hiring and growing a team, including senior engineers.


• Excellent spoken and written communication skills.


• Comfort operating in ambiguity and reshaping team scope as the domain m

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $237,600 and $356,400, and your base pay will depend on your skills, qualifications, experience, and location.

• Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs.


• Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan.


• You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition.


• Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation.

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant

At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.
Learn about accessibility in Apple’s workplace
Learn about reasonable accommodations for job applicants

Apple accepts applications to this posting on an ongoing basis.