AIML - Sr Machine Learning Engineer, Responsible AI

Apple Inc.; Cupertino (CA); Hybrid; USD 181,100 - 318,400; Full time

Benefits offered by this job

Comprehensive medical and dental coverage

Retirement benefits

Employee stock purchase plan

Tuition reimbursement

Discounted products and services

Job summary

A leading technology company seeks a Senior Machine Learning Engineer to focus on building generative AI applications. This role involves assessing the safety of Apple's AI features and requires an advanced degree in computer science or related fields. Candidates should have experience with generative models, Python coding skills, and knowledge of fairness in AI. This position offers competitive compensation ranging from $181,100 to $318,400, plus benefits and stock participation.

Qualifications

• Master's degree or PhD in relevant field required.
• Experience with generative models for evaluation and product development.
• Strong coding skills in Python essential.
• Background in AI programming focusing on foundation models expected.
• Experience with noisy crowd-based data labels is necessary.

Responsibilities

• Develop metrics for evaluating safety and fairness risks of generative AI.
• Design and scale datasets using human and synthetic data methods.
• Create auto-grading technologies for safety evaluations.
• Provide technical expertise for team-wide safety initiatives.
• Collaborate across functions for end-to-end safety evaluations.

Skills

Generative models

Python programming

Data analysis

Fairness and bias in AI

Education

MS or PhD in Computer Science, Machine Learning, Statistics or related fields

Tools

DSPy

Job description

AIML - Sr Machine Learning Engineer, Responsible AI

Cupertino, California, United States Machine Learning and AI

Would you like to play a part in building the next generation of generative AI applications at Apple? We’re looking for Machine Learning Engineers to work on ambitious projects that will impact the future of Apple, our products, and the broader world. This role is directed at assessing, quantifying, and improving the safety and inclusivity of Apple’s Generative‑AI powered features and products.

In this role you’ll have the opportunity to tackle innovative problems in machine learning, particularly focused on large language models for text generation, diffusion models for image generation, and mixed model systems for multimodal applications. As a member of Apple’s Responsible AI group you will be working on a wide array of new features and research in the generative AI space. Our team is currently interested in large generative models for vision and language, with particular interest on Responsible AI, safety, fairness, robustness, explainability, and uncertainty in models.

Description

This role focuses on developing, carrying‑out, interpreting, and communicating pre‑ and post‑ship evaluations of the safety of Apple Intelligence features. Both human grading and model‑based auto‑grading are thoughtfully leveraged to power these evaluations. Additionally, this role researches and develops auto‑grading methodology & infrastructure to benefit ongoing and future Apple Intelligence safety evaluations. Producing safety evaluations that uphold Apple’s Responsible AI values requires thoughtful data sampling, creation, and curation for evaluation datasets; high quality, detailed annotations and careful auto‑grading to assess feature performance; and mindful analysis to understand what the evaluation means for the user experience. This role heavily draws on applied data science, scientific investigation and interpretation, cross‑functional communication and collaboration, and metrics reporting and presentation.

Responsibilities

• Develop metrics for evaluation of safety and fairness risks inherent to generative AI features.
• Design datasets, identify data needs, and work on creative solutions, scaling and expanding data coverage through human and synthetic generation methods.
• Develop auto‑grading technologies and approaches for application in safety evaluations of generative AI features.
• Provide technical direction and expertise to team‑wide initiatives in safety auto‑grading.
• Use and implement data pipelines, and collaborate cross‑functionally to execute end‑to‑end safety evaluations.
• Work with highly‑sensitive content with exposure to offensive and controversial content.

Minimum Qualifications

• MS, or PhD in Computer Science, Machine Learning, Statistics, or related fields; or an equivalent qualification acquired through other avenues.
• Experience working with generative models for evaluation and/or product development, and up‑to‑date knowledge of common challenges and failures.
• Strong engineering skills and experience in writing production‑quality code in Python.
• Deep experience in foundation model‑based AI programming (i.e.: using DSPy for optimizing foundation model prompts, for example) and a drive to innovate in this space.
• Experience working with noisy, crowd‑based data labels and human evaluations.

Preferred Qualifications

• Experience working in the Responsible AI space.
• Prior scientific research and publication experience.
• Strong organizational and operational skills working with large, multi‑functional, and diverse teams.
• Curiosity about fairness and bias in generative AI systems, and a strong desire to help make the technology more equitable.

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $181,100 and $318,400, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan.

You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits.

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant .

Apple accepts applications to this posting on an ongoing basis.