Applied Machine Learning Research Engineer

Apple; Sunnyvale (CA); On-site; USD 140,000 - 210,000; Full time

Job summary

Apple is seeking a highly motivated Applied Machine Learning Research Engineer to join the Video Computer Vision group in Sunnyvale, CA. You will work on multimodal AI that integrates text, image, video, and audio to advance Apple’s computer vision capabilities and real-time features.

You will design, implement, and evaluate algorithms and models, collaborating with researchers, software engineers, and HW/SW teams to push the boundaries of human understanding.

Qualifications

• Bachelor's degree required with 3+ years of relevant industry experience.
• Experience developing, training and tuning multimodal LLMs.
• Programming skills in Python and deep learning frameworks.

Responsibilities

• Work on cutting-edge research to advance AI and computer vision capabilities.
• Design, implement, and evaluate algorithms and models for multimodal data.
• Collaborate with researchers, engineers, and domain experts to drive innovation.

Skills

Python

Multimodal LLMs

Computer Vision

NLP

Generative AI

Education

Bachelor's Degree

Tools

PyTorch

JAX

Job description

Summary

We’re starting to see the incredible potential of multimodal foundation and large language models, and many applications in the computer vision and machine learning domain that previously appeared infeasible are now within reach. We are looking for a highly motivated and skilled Applied Machine Learning Research Engineer to join our team in the Video Computer Vision group and help us push the boundaries of human understanding. The Video Computer Vision org has pioneered human-centric real-time features such as FaceID, FaceKit, and Gaze and Hand gesture control which have changed the way millions of users interact with their devices. We balance research and product requirements to deliver Apple quality, state-of-the-art experiences, innovating through the full stack, and partnering with HW, SW and AI teams to shape Apple’s products and bring our vision to life.

Description

We are seeking a highly motivated and skilled Applied Machine Learning Research Engineer to join our team. You’ll work on cutting-edge research projects to advance our AI and computer vision capabilities, contribute to both foundational research and practical applications on multimodal large language models, and design, implement, and evaluate algorithms and models for human understanding. You have a strong background in developing and exploring multimodal large language models that integrate diverse data modalities such as text, image, video, and audio. You’ll have the opportunity to collaborate with cross-functional teams, including researchers, data scientists, software engineers, human interface designers and application domain experts. You’ll stay up-to-date on the latest advancements in AI, machine learning, and computer vision and apply this knowledge to drive innovation within the company.

Minimum Qualifications

Bachelors Degree and a minimum of 3 years relevant industry experienceExperience in developing, training/tuning multimodal LLMsProgramming skills in Python

Preferred Qualifications

Expertise in one or more of: computer vision, NLP, multimodal fusion, Generative AI.Experience with at least one deep learning framework such as JAX, PyTorch, or similar.Publication record in relevant venues.PhD in Computer Science, Electrical Engineering, or a related field with a focus on AI, machine learning, or computer vision.