Machine Learning Researcher Multi-Modal Reasoning

Socket.dev; Cupertino (CA); On-site; USD 250,000 - 350,000; Full time

Job summary

SIML's Content Understanding team at Apple Intelligence is seeking a senior technical leader to architect and deploy production-scale multimodal ML. You will oversee ML modeling, prototyping, validation and private learning, working across teams to translate research into user-focused experiences.

Ideal candidates have strong ML fundamentals, experience with large language models, and a track record of research contributions in top venues or open source projects.

Qualifications

• PhD or MSc in Computer Science/Electrical Engineering, or related field (mathematics, physics, CE).
• Hands-on experience training LLMs/adapting pre-trained LLMs for tasks & alignment.
• Modeling experience at the intersection of NLP and Vision.
• Proficiency with ML toolkit of choice, e.g., PyTorch.
• Strong Python programming skills.
• Proven research contributions via publications or open source work.

Responsibilities

• Lead ML modeling, prototyping, validation and private learning across multimodal initiatives.
• Coordinate with cross-functional teams to bring research into production scale deployments.
• Partner with systems engineers to prototype bleeding-edge algorithmic innovations.
• Interface with large-scale modeling and data infrastructure to enable scalable solutions.

Skills

LLM training

NLP & Vision

Python

Research publications

Multimodal ML

Education

PhD or MSc in CS/EE or related field

Tools

PyTorch

Job description

Do you believe generative models can transform creative workflows and smart assistants used by billions? Do you believe it can fundamentally shift how people interact with devices and communicate, personalizing and tailoring experiences to their unique needs? SIML's Content Understanding teams strives to turn cutting edge research into compelling user experiences that realize all these goals and more, working on Apple Intelligence technologies such as Image Playground, Genmoji, Generative Memories, Semantic Search, and many more. You will be working alonside teams that are in charge of operating system wide embeddings, personalized RAG workstreams, tool calling, context compaction / efficiency & memory systems. Projects are focussed on advancing Apple Intelligence capabilities, while working closely across disciplines with our partners in hardware engineering, design and product.

Description

We are looking for a senior technical leader experienced in architecting and deploying production scale multimodal ML. An ideal candidate has the ability to lead diverse cross functional efforts ranging from ML modeling, prototyping, validation and private learning. Solid ML fundamentals and an ability to place research contributions with respect to state of the art would be an essential part of the role. Experience with training and adapting large language models would be an important need. This role includes the opportunity to partner with world class system engineers to prototype and incorporate bleeding edge algorithmic innovations in the context of emerging agentic experiences. Ability to interface with large scale modeling & data infrastructure is a huge plus.

Minimum Qualifications

• PhD, or MSc in Computer Science/Electrical Engineering, or a related field (mathematics, physics or computer engineering); with a focus on machine learning, or comparable professional experience.
• Hands on experience training LLMs/adapting pre-trained LLMs for downstream tasks & alignment.
• Modeling experience at the intersection of NLP and Vision.
• Proficiency in ML toolkit of choice, e.g., PyTorch.
• Strong programming skills in Python.
• Proven track record of research contributions demonstrated through publications in top-tier conferences, or open source contributions to algorithm.

Preferred Qualifications

• Experience with building & deploying Multimodal-LLMs.
• Familiarity with distributed training and large-scale data infrastructure.