Senior AI Safety & Evaluation Engineer

Apple Inc.; Seattle (WA); On-site; USD 184,700 - 324,800; Full time

Benefits offered by this job

Employee stock purchase plan

Relocation assistance

Education reimbursement

Job summary

Apple Inc. in Cupertino, California, is seeking a Sr Machine Learning Engineer for Responsible AI to assess and improve safety and inclusivity of Generative AI features. You’ll work on large language models, diffusion, and multimodal systems, delivering evaluations and auto-grading approaches.

You will collaborate across teams, apply data science methods, and report findings to influence product experiences, with focus on fairness, robustness, and user impact.

Qualifications

• MS/PhD in Computer Science, Machine Learning, Statistics, or related fields; or an equivalent qualification acquired through other avenues.
• Experience working with generative models for evaluation and/or product development, and up‑to‑date knowledge of common challenges and failures.
• Strong engineering skills and experience in writing production‑quality code in Python.
• Deep experience in foundation model‑based AI programming (i.e.: using DSPy for optimizing foundation model prompts, for example) and a drive to innovate in this space.
• Experience working with noisy, crowd‑based data labels and human evaluations.

Responsibilities

• Develop metrics for evaluation of safety and fairness risks inherent to generative AI features.
• Design datasets, identify data needs, and work on creative solutions, scaling and expanding data coverage through human and synthetic generation methods.
• Develop auto‑grading technologies and approaches for application in safety evaluations of generative AI features.
• Provide technical direction and expertise to team‑wide initiatives in safety auto‑grading.
• Use and implement data pipelines, and collaborate cross‑functionally to execute end‑to‑end safety evaluations.
• Work with highly‑sensitive content with exposure to offensive and controversial content.

Skills

Gen AI evaluation

Python

Foundation models

Noisy data handling

DSPy

Education

MS/PhD in Computer Science or related

Tools

DSPy

Job description

Apple Inc. in Cupertino, California, is seeking a Sr Machine Learning Engineer for Responsible AI to assess and improve safety and inclusivity of Generative AI features. You’ll work on large language models, diffusion, and multimodal systems, delivering evaluations and auto-grading approaches.

You will collaborate across teams, apply data science methods, and report findings to influence product experiences, with focus on fairness, robustness, and user impact.