Multimodal AI Researcher: Generative Models, Realtime Vision

Socket.dev; Sunnyvale (CA); Hybrid; USD 150,000 - 230,000; Full time

Job summary

Apple in Sunnyvale is seeking a Multimodal AI Researcher to push the boundaries of foundation models for real-time multimodal data, including video, audio, and text. You will work on interactive models, audio-to-audio modeling, and streaming multimodal systems, driving data requirements, validation strategies, and delivering research that informs product features.

Ideal candidates have a BS with 3+ years of experience, hands-on work with LLMs and VLMs, and strong Python/PyTorch skills.

Qualifications

• BS and a minimum of 3 years relevant industry experience.
• Experience building models for multimodal perception systems.
• Experience working with LLMs and VLMs.
• Software engineering skills with Python and PyTorch.
• Curiosity and willingness to learn new things to improve solutions.

Responsibilities

• Conduct algorithm research and development for multimodal foundational models and agents.
• Collaborate with data science, ML, and product teams to define requirements and KPIs.
• Translate research into product features used by millions of users across Apple devices.

Skills

Multimodal AI

Python

PyTorch

LLMs

VLMs

Research experience

Education

BS in related field

MS or PhD in related fields

Job description

Apple in Sunnyvale is seeking a Multimodal AI Researcher to push the boundaries of foundation models for real-time multimodal data, including video, audio, and text. You will work on interactive models, audio-to-audio modeling, and streaming multimodal systems, driving data requirements, validation strategies, and delivering research that informs product features.

Ideal candidates have a BS with 3+ years of experience, hands-on work with LLMs and VLMs, and strong Python/PyTorch skills.