Engineering Leader, AI Safety Engineering & Evaluation, Apple Services Engineering

Apple Inc.; Cupertino (CA); Presencial; USD 238.000 - 402.000; Jornada completa

Descripción de la vacante

Apple Inc. is seeking an experienced Engineering Leader to head AI Safety Engineering & Evaluation within the Human-Centered AI organization.

You will drive the development of scalable, automated safety evaluation capabilities for AI-powered experiences across Apple services. You will lead a multidisciplinary team, shape technical direction, and collaborate with product, privacy, legal, and safety policy teams to translate safety requirements into measurable technical standards and actionable

Formación

• 12+ years of software/ML engineering experience delivering production-quality systems.
• 8+ years of engineering or ML management experience with at least 3 years leading engineering managers.
• Experience building or transforming engineering organizations and scaling teams.
• Strong foundation in software engineering, architecture, and operations of complex AI/ML systems.
• Practical expertise in ML and modern AI architectures, including model development, inference, and evaluation methodologies.
• Strong Python skills and modern software development practices.

Responsabilidades

• Define and execute the technical strategy and multi-year roadmap for AI safety engineering and evaluation.
• Lead automated, model-based evaluation approaches for safety assessment and bias/robustness checks.
• Direct scalable safety evaluation workflows, automated testing, and risk-analysis pipelines.
• Collaborate with cross-functional teams to translate safety requirements into measurable technical criteria and deliverable assessments.

Conocimientos

Engineering leadership

Machine learning

Team leadership

Python

Roadmap planning

Stakeholder management

Communication skills

Educación

Bachelor's degree in CS / related field

Herramientas

Python

ML frameworks

Descripción del empleo

Cupertino, California, United States Software and Services

Apple Services Engineering (ASE) powers AI and machine learning experiences across the App Store, Apple Music, Apple TV, and more. We build intelligent, deeply personal experiences designed to serve users around the world. Ensuring these experiences are safe, trustworthy, and representative of the diverse communities we serve is fundamental to how we develop and deploy AI.We are seeking an experienced engineering leader to lead AI Safety Engineering & Evaluation within the Human-Centered AI organization. This role combines software engineering, machine learning, evaluation science, and Responsible AI to develop scalable capabilities for identifying, measuring, and mitigating risks associated with AI-powered experiences.You will lead an emerging, multidisciplinary organization of engineering managers, engineers, and applied scientists, building the technical expertise, engineering practices, and organizational capabilities needed to scale AI safety evaluation. This is an opportunity to shape a growing function, developing its technical foundations while transforming manual safety assessments into automated, scientifically rigorous processes.The ideal candidate brings strong engineering leadership, practical expertise in machine learning and modern AI systems, and demonstrated success building technical organizations and translating complex challenges into measurable engineering outcomes.

Description

As the Engineering Leader for AI Safety Engineering & Evaluation, you will lead the development and operationalization of technical capabilities to systematically assess AI model behavior, identify potential harms, and measure the effectiveness of safety mitigations.Your organization will advance safety evaluation methodologies, model-based assessment, adversarial testing, automated risk identification, and failure analysis. In partnership with Evaluation Systems & Research (ESR), which provides shared evaluation infrastructure and services, you will integrate safety-specific models, assessment workflows, and measurement capabilities into scalable evaluation systems.You will establish the technical direction, organizational structure, and engineering practices needed for a growing team to operate effectively. This requires a leader who can engage deeply in technical decisions, develop engineering managers and senior contributors, and progressively build the organization's ability to deliver complex technical solutions.You will work closely with machine learning engineering, research, product, privacy, legal, and safety policy teams to translate safety requirements into measurable technical standards and actionable insights that inform AI development and deployment decisions.

Responsibilities

• Technical Strategy & Organizational Leadership: Develop and execute the technical strategy and multi-year roadmap for AI safety engineering and evaluation, aligning priorities with broader organizational objectives. Build, scale, and mentor an emerging multidisciplinary organization of engineering managers, software engineers, machine learning engineers, and applied scientists while owning staffing, resource planning, performance management, and delivery commitments. Provide hands-on technical direction across safety-specific modeling and automated assessments, establishing rigorous engineering standards, review practices, and operating mechanisms that improve execution, maintainability, and organizational effectiveness as the team matures.
• AI/ML Evaluation & Safety Assessment: Lead the development of automated, model-based evaluation approaches (including LLM-as-a-judge, multi-model assessment, and automated classification) to assess models and product experiences for harmful content, bias, robustness, and Responsible AI risks. Establish scientifically rigorous evaluation methodologies, benchmarks, and experimental metrics to quantitatively measure model behavior and mitigation effectiveness. Advance synthetic data generation, scenario-based testing, and automated red teaming to identify systematic failure patterns and characterize emerging safety risks across diverse user experiences.
• Engineering Execution & Scalable Automation: Direct the implementation of safety evaluation workflows, model-based assessors, automated testing logic, and risk-analysis pipelines. Partner closely with Evaluation Systems & Research (ESR) to integrate domain-specific safety capabilities into shared evaluation platforms, transitioning manual expert reviews into repeatable, automated processes embedded in model development, experimentation, and release workflows. Establish robust practices for evaluation data management, benchmark quality, test coverage, and continuous measurement, while managing technical dependencies and delivery priorities across partner engineering teams.
• Cross-Functional Leadership & Influence: Partner with AI/ML engineering, research, product, privacy, legal, and safety policy teams to translate high-level safety and governance requirements into measurable technical criteria and evaluation capabilities. Influence AI development and product release decisions through evidence-based assessments of model capabilities, limitations, and mitigation efficacy. Communicate technical strategy, evaluation results, and emerging risks to senior engineering, product, and executive stakeholders, establishing cross-functional operating models that embed automated safety assessments into engineering workflows and reduce reliance on manual expert reviews.

Minimum Qualifications

• 12+ years of experience in software engineering, machine learning engineering, applied AI, or related technical disciplines, including demonstrated experience delivering complex production-quality systems.
• 8+ years of engineering or applied machine learning management experience, including at least 3 years managing engineering managers or leading multiple technical teams through established managers.
• Demonstrated experience building or transforming engineering organizations, including developing technical talent, establishing engineering practices, and scaling teams through periods of organizational or technical growth.
• Strong software engineering foundation, including experience guiding architecture, implementation, and operationalization of complex software or AI/ML solutions.
• Practical expertise in machine learning and modern AI architectures, including model development, inference, and evaluation methodologies.
• Strong technical foundation in Python and modern software development practices, with the ability to assess technical tradeoffs and guide engineering execution.
• Demonstrated ability to develop technical roadmaps, establish priorities, manage resources, and deliver measurable outcomes in ambiguous environments.
• Excellent communication and stakeholder management skills, with experience influencing senior technical and cross-functional leaders.
• Bachelor's degree in Computer Science, Machine Learning, Engineering, or a related technical field, or equivalent practical experience.

Preferred Qualifications

• Experience leading teams developing AI/ML evaluation systems, automated model assessment, or applied machine learning solutions.
• Experience with generative AI and large language models, including LLM-based evaluation, agentic systems, model orchestration, or adversarial testing.
• Applied experience with machine learning modeling, statistical analysis, experimental design, and quantitative evaluation methods.
• Experience developing automated model assessors, synthetic data generation, red teaming, or systematic failure analysis capabilities.
• Familiarity with Responsible AI principles and technical approaches to fairness, bias, robustness, harmful content, and safety risk assessment.
• Experience integrating evaluation capabilities into existing engineering platforms, development workflows, or continuous measurement processes.
• Experience leading multidisciplinary engineering organizations through technical transformation, particularly involving automation or applied machine learning.
• Ability to translate emerging research techniques into reliable engineering implementations.
• Advanced degree in Computer Science, Machine Learning, Artificial Intelligence, or a related technical discipline.

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $237,600 and $401,700, and your base pay will depend on your skills, qualifications, experience, and location.
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant

At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.
Learn about accessibility in Apple’s workplace
Learn about reasonable accommodations for job applicants

Apple accepts applications to this posting on an ongoing basis.