AIML - Machine Learning Manager, Red Teaming - Responsible AI and Safety

Apple, Inc.

San Francisco (CA)

Sur place

USD 190 000 - 260 000

Plein temps

14 jours+

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Résumé du poste

Apple's Responsible AI and Safety team seeks a leader to build and manage a red-teaming program focused on adversarial risks in generative AI.

You will lead engineers, coordinate with model teams, and define success metrics while upholding privacy and quality standards.

Join a cross-functional environment to scale a strategic program at Apple, shaping safety practices for cutting-edge AI technologies.

Qualifications

  • MS, or PhD in Computer Science, Machine Learning, Statistics, or related fields; or an equivalent qualification acquired through other avenues.
  • Experience working with generative models for evaluation and/or product development, and up-to-date knowledge of common challenges and failures. Strong engineering skills and experience in writing production-quality code in Python.
  • Deep experience in foundation model-based AI programming (i.e.: using DSPy for optimizing foundation model prompts, for example) and a drive to innovate in this space. Experience working with noisy, crowd-based data labels and human evaluations.

Responsabilités

  • Build and lead a team of red-teaming engineers, each with sustained ownership of a feature cluster
  • Set an independent red-teaming agenda, distinct from standard evaluation, focused on active vulnerability discovery
  • Own coverage strategy across pre-ship qualification, post-ship monitoring, and foundation model red-teaming, in partnership with relevant model teams
  • Define division of responsibility with adjacent security teams on cross-cutting risks and coordinate escalation paths
  • Own external red-teaming partnerships, including scoping value, cost, and pipeline integration
  • Define, instrument, and report on red-teaming success criteria to leadership on a recurring basis
  • Provide technical direction on automated red-teaming capabilities
  • Work with highly sensitive content, including exposure to offensive and controversial material; Build and report high visibility and compliant reporting capabilities

Connaissances

Leadership
Adversarial AI
Python
Production-grade code
Cross-functional collaboration

Formation

MS/PhD in CS/ML/Statistics

Outils

DSPy

Description du poste

AIML - Machine Learning Manager, Red Teaming - Responsible AI and Safety

San Francisco Bay Area, California, United States Machine Learning and AI

Apple's Responsible AI and Safety team focuses on innovative technologies, methodologies, and research to enable fantastic user experiences and to push the frontier of machine learning. Our team is looking to hire a leader with a strong track record in AI red-teaming and adversarial security research, who is passionate about proactively finding real vulnerabilities in generative AI systems before they reach users.In this role, you will lead a dedicated red-teaming team, building and running an independent program that actively probes Apple Intelligence features for safety and security risks, while upholding Apple's values, privacy, and quality standards.

Description

This role focuses on leading a team that sets its own red-teaming agenda, independent from standard evaluation, and is responsible for actively probing Apple Intelligence features to discover real vulnerabilities rather than measuring known ones. This team is also responsible for building the operating model to support that work: hiring and developing red-teaming engineers with sustained feature ownership, working with a skill crowd workforce paired directly with those engineers, and standing up automated red-teaming capabilities.Leading this function requires clear division of responsibility with adjacent security and evaluation teams, sound judgment on which findings warrant escalation, and the ability to define success criteria for a program that doesn't yet have established metrics. This role also involves managing external red-teaming partnerships to extend coverage at scale, and communicating findings and program impact to leadership on a recurring basis.This role heavily draws on technical leadership in AI safety or security, program-building in ambiguous or newly-scoped territory, cross-functional negotiation, and metrics definition and reporting.

Responsibilities
  • Build and lead a team of red-teaming engineers, each with sustained ownership of a feature cluster
  • Set an independent red-teaming agenda, distinct from standard evaluation, focused on active vulnerability discovery
  • Own coverage strategy across pre-ship qualification, post-ship monitoring, and foundation model red-teaming, in partnership with relevant model teams
  • Define division of responsibility with adjacent security teams on cross-cutting risks (e.g., prompt injection) and coordinate escalation paths
  • Own external red-teaming partnerships, including scoping value, cost, and pipeline integration
  • Define, instrument, and report on red-teaming success criteria to leadership on a recurring basis
  • Provide technical direction on automated red-teaming capabilities
  • Work with highly sensitive content, including exposure to offensive and controversial materialBuild and report high visibility and compliant reporting capabilities
Minimum Qualifications
  • MS, or PhD in Computer Science, Machine Learning, Statistics, or related fields; or an equivalent qualification acquired through other avenues.
  • Experience working with generative models for evaluation and/or product development, and up-to-date knowledge of common challenges and failures.Strong engineering skills and experience in writing production-quality code in Python.
  • Deep experience in foundation model-based AI programming (i.e.: using DSPy for optimizing foundation model prompts, for example) and a drive to innovate in this space.Experience working with noisy, crowd-based data labels and human evaluations.
Preferred Qualifications
  • Publication record in relevant conferences (e.g., NeurIPS, ICML, ICLR, EMNLP, etc.)
  • Experience working on Responsible AI and AI SafetyStrong organizational and operational skills working with large, multi-functional, and diverse teams.
  • Curiosity about fairness and bias in generative AI systems, and a strong desire to help make the technology more equitable.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant

At Apple, we believe accessibility is a fundamental human right. You will find that idea reflected in everything here - in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.
Learn about accessibility in Apple's workplace
Learn about reasonable accommodations for job applicants

Apple accepts applications to this posting on an ongoing basis.

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

AI Safety - Machine Learning and Applied Research
AI Safety - Machine Learning and Applied Research

Apple Inc. • Seattle (WA)

Sur place
USD 120 000 - 150 000
AI Safety - Machine Learning and Applied Research
AI Safety - Machine Learning and Applied Research

Apple Inc. • Cupertino (CA)

Sur place
USD 120 000 - 160 000
AIML - Senior ML Engineer, Responsible AI and Safety
AIML - Senior ML Engineer, Responsible AI and Safety

Apple Inc. • Cupertino (CA)

Sur place
USD 181 100 - 318 400
Comprehensive medical and dental coverage
Retirement benefits
Education reimbursement
+2
AI Safety - Machine Learning and Applied Research
AI Safety - Machine Learning and Applied Research

Apple Inc. • San Francisco (CA)

Sur place
USD 120 000 - 160 000
AI Safety - Machine Learning and Applied Research
AI Safety - Machine Learning and Applied Research

Apple Inc. • Pittsburgh

Sur place
USD 100 000 - 130 000
AIML - Machine Learning Manager - Responsible AI and Safety
AIML - Machine Learning Manager - Responsible AI and Safety

Apple, Inc. • San Francisco (CA)

Sur place
USD 206 000 - 356 000
Medical coverage
Dental coverage
Retirement benefits
+3
Senior AI Safety & Responsible ML Research Lead
Senior AI Safety & Responsible ML Research Lead

Apple Inc. • Cupertino (CA)

Hybride
USD 216 000 - 394 000
AIML - Machine Learning Engineering Manager, Evaluation - Responsible AI and Safety
AIML - Machine Learning Engineering Manager, Evaluation - Responsible AI and Safety

Apple, Inc. • Cupertino (CA)

Sur place
USD 185 000 - 325 000
Medical and dental coverage
Retirement benefits
Employee stock purchase plan
+4
Sr. Machine Learning Engineer
Sr. Machine Learning Engineer

Apple, Inc. • Santa Clara (CA)

Sur place
USD 185 000 - 278 000
Comprehensive medical and dental cover
Retirement benefits
Discounted products and free services
+3
AIML - Quality Engineering Manager, Responsible AI and Safety
AIML - Quality Engineering Manager, Responsible AI and Safety

Apple, Inc. • Cupertino (CA)

Sur place
USD 238 000 - 402 000
Comprehensive medical and dental
Retirement benefits
Discounted products and free services
+2