ML Research Engineer, HOUr - ISE

Apple, Inc.

Cupertino (CA)

On-site

USD 150,000 - 278,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

The Human and Object Understanding (HOUr) team in Apple's Intelligent System Experience (ISE) organization is seeking ML research engineers to advance face understanding and analysis. You will develop state-of-the-art visual identity, facial attribute, gaze, and liveness solutions, partnering with product teams to ship impactful features across Apple platforms.

You will work with world-class researchers and engineers to push real-time performance, leverage large-scale foundation models, and

Qualifications

  • Advanced degree in CS/CE or related field, or comparable professional experience.
  • Extensive experience with large-scale foundation models including multi-modal LLMs or vision-language models.
  • Proficient in Python and PyTorch or equivalent DL frameworks.

Responsibilities

  • Design and deploy state-of-the-art ML solutions for advanced face analysis and understanding.
  • Leverage pre-trained large-scale visual/multimodal foundation models via adapters or distillation.
  • Communicate results and insights to partners and leaders with clear, actionable recommendations.
  • Stay up-to-date with trends in computer vision, ML, and large-scale foundation models.
  • Mentor practitioners and contribute to shared ML infrastructure.

Skills

Foundation models
Python
PyTorch
Research leadership

Education

Masters or PhD in CS/CE

Tools

Multi-modal LLMs
Vision-language models
Adapters/Distillation

Job description

The Human and Object Understanding (HOUr) team in the Intelligent System Experience (ISE) organization at Apple is Looking for ML research engineers in the space of advanced face understanding and analysis. This is an opportunity to join a team that built the enabling ML technologies behind a number of marquee products and features such as:

  • Visual User Identification stack for Apple HomeView.
  • Visual Age Estimation for Child Safety on Apple Platforms.
  • Gaze understanding in Camera & Photos, Accessibility.
  • Liveness assessment for IDs in Apple Wallet, and more.
Description

You must have a proven track record of domain expertise and technical leadership in applied ML research.

You will partner closely with feature and product teams across the company to build use-case specific and feature enabling technologies in areas such as understanding visual identity, facial attributes, face liveness and anti-spoofing, eye tracking and gaze analysis.

You will leverage state-of-the-art techniques to develop highly efficient, real-time solutions where needed, and/or also leverage pre-trained large scale visual/multimodal foundation models to achieve state-of-the-art quality for specific downstream use-cases.

You will be interacting very closely with a variety of ML leaders, researchers, software engineers, hardware & design teams cross-functionally in order to build and ship new experiences based on your technologies.

Ensuring quality in the field, with an emphasis on fairness and model robustness would constitute an important part of the role.

Responsibilities
  • Designing, implementing, and deploying state-of-the-art ML solutions for advanced face analysis and understanding.
  • Leverage pre-trained large scale visual/multimodal foundation models to solve feature specific needs via training adapters or distilling to smaller footprints as required
  • Effectively communicating results and insights gained to partners and leaders, providing clear and actionable recommendations.
  • Staying abreast with the latest trends, technologies, and best practices in computer vision, machine learning, and large scale foundation models.
  • Actively contributing to ML community at the company by disseminating research ideas and results, enhancing shared infrastructure, and mentoring fellow practitioners.
Minimum Qualifications
  • Masters, or Ph.D. in Computer Science, or Computer Engineering; similarly related fields, or comparable professional experience.
  • Extensive knowledge and experience in leveraging large scale foundation models including multi-modal LLMs or vision-language models, including adapting/distilling pre-trained models for downstream perception tasks.
  • Strong programing skills in Python and proficiency in toolkits like Pytorch or equivalent deep learning frameworks.
  • Proficiency in leveraging AI coding and productivity tools, to supercharge experimentation and model training iterations.
Preferred Qualifications
  • Strong background in research and innovation, demonstrated through publications in top-tier journals or conferences, patents, or impactful industry experience.
  • Experience in addressing challenges associated with the transition of a prototype into a shipping product.
  • Familiarity with challenges of developing algorithms that run efficiently on resource-constrained platforms.
  • Excellent written and verbal communication skills, be comfortable presenting research to large audiences, and have the ability to work in multi-functional teams.
Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $150,400 and $277,600, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses - including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Machine Learning Research Engineer Job ID- 959 Job ID- 3192
Machine Learning Research Engineer Job ID- 959 Job ID- 3192

MaziCTools • United States

Remote
USD 143,000 - 215,000
Medical and dental coverage
Retirement benefits
Discounted products and services
+2
CV & ML Engineer
CV & ML Engineer

Apple, Inc. • Sunnyvale (CA)

On-site
USD 150,000 - 278,000
Stock options
Medical & dental coverage
Retirement benefits
+2
AIML - Machine Learning Engineer, Visual Intelligence Technology
AIML - Machine Learning Engineer, Visual Intelligence Technology

Apple Inc. • Santa Clara (CA)

On-site
USD 181,100 - 318,400
Comprehensive medical and dental coverage
Retirement benefits
Employee stock purchase plans
+1
Machine Learning Research Engineer, SIML - ISE
Machine Learning Research Engineer, SIML - ISE

Apple, Inc. • Cupertino (CA)

On-site
USD 150,000 - 278,000
Lead Machine Learning Engineer, Human Sensing
Lead Machine Learning Engineer, Human Sensing

Apple, Inc. • Seattle (WA)

On-site
USD 175,000 - 309,000
Medical and dental coverage
Employee stock programs
Relocation assistance
Machine Learning Engineer – Computer Vision & Data Systems
Machine Learning Engineer – Computer Vision & Data Systems

Apple, Inc. • Sunnyvale (CA)

On-site
USD 181,000 - 318,000
Stock options plan
Discretionary bonuses
Relocation assistance
+2
Applied Machine Learning Research Engineer - Multimodal for Human Understanding
Applied Machine Learning Research Engineer - Multimodal for Human Understanding

Apple, Inc. • Sunnyvale (CA)

On-site
USD 150,000 - 278,000
Medical and dental coverage
Retirement benefits
Employee stock programs
+2
AIML – ML Engineer, MLR Job ID- 989 Job ID- 3227
AIML – ML Engineer, MLR Job ID- 989 Job ID- 3227

MaziCTools • United States

Remote
USD 143,000 - 264,000
Apple stock programs
Educational expense reimbursement
Relocation assistance
ML - Data Scientist
ML - Data Scientist

Apple, Inc. • Sunnyvale (CA)

On-site
USD 185,000 - 325,000
Senior ML Researcher: Multimodal LLM Post-Training
Senior ML Researcher: Multimodal LLM Post-Training

Apple, Inc. • Cupertino (CA)

On-site
USD 185,000 - 325,000
Comprehensive medical and dental cover
Retirement benefits
Discounted products and free services
+2