Senior ML Engineer — Responsible AI Safety & Evaluation

Apple, Inc.; Cambridge (MA); On-site; USD 166,000 - 292,000; Full time

Benefits offered by this job

Employee stock programs

Relocation assistance

Comprehensive medical & dental

Job summary

Apple in Cambridge, MA is seeking a Senior Machine Learning Engineer to lead Responsible AI Evaluation for next-gen generative features. You will develop measurable safety criteria, design data collection and evaluation datasets, and build robust pipelines for scalable insights.

You will work hands-on across LLMs, diffusion models, and multimodal systems, collaborating with engineering, privacy, and policy teams to ensure safe and inclusive products for users worldwide.

Qualifications

• Develop metrics for evaluating safety and fairness risks inherent to generative models and Gen-AI features.
• Design datasets, identify data needs, and implement creative solutions to scale and expand data coverage through human and synthetic generation methods.
• Develop sampling strategies and combine human annotation with auto‑grading to deliver high-quality, high‑confidence insights at a fast pace and large scale.
• Design, implement, and optimize data pipelines, collaborating cross‑functionally to execute end‑to‑end safety evaluations.
• Drive operational excellence by automating manual workflows and optimizing evaluation velocity to meet rapid product release cycles.
• Distill complex project findings into actionable insights for product engineering teams and safety policy development.
• Work with highly‑sensitive content, including exposure to offensive and controversial material.

Responsibilities

• Lead end-to-end safety evaluations for global generative AI features.
• Develop and operationalize policy risk assessments into measurable criteria.
• Collaborate with cross-functional teams to drive safety improvements across products.
• Analyze evaluation results, conduct failure investigations, and iterate with human feedback to improve safety metrics.

Skills

Safety metrics design

Data pipeline development

Human-in-the-loop methods

Sampling strategies

Cross-functional collaboration

Handling sensitive content

Job description

Apple in Cambridge, MA is seeking a Senior Machine Learning Engineer to lead Responsible AI Evaluation for next-gen generative features. You will develop measurable safety criteria, design data collection and evaluation datasets, and build robust pipelines for scalable insights.

You will work hands-on across LLMs, diffusion models, and multimodal systems, collaborating with engineering, privacy, and policy teams to ensure safe and inclusive products for users worldwide.