Multimodal AI Scientist - LLMs, Vision & Audio

Apple Inc.; Cupertino (CA); On-site; USD 180,000 - 260,000; Full time

Job summary

Apple Inc. is seeking a Multimodal AI applied scientist to drive multimodal scene understanding and human-centric device interaction.

You will develop multimodal LLMs to perceive environments and understand user behaviors, preferences, and interactions, spanning architecture design, model training, and deployment. You will work on assembling robust ML models and APIs that fit into Apple’s production pipelines, collaborating across teams to push the boundaries of foundation models and real-time

Qualifications

• PhD or MS in Computer Science, Engineering, or related field with ML focus.
• First-author publications in top-tier ML conferences.
• Expert knowledge of SOTA in large auto-regressive transformers, multimodal encoders, and representation learning.
• Experience with multimodal LLMs.
• Strong Python programming with ML code grounded in software engineering.

Responsibilities

• Design, train, and deploy large-scale multimodal LLMs, owning the lifecycle from architecture to deployment.
• Create human-centric user experiences using foundation models.
• Build robust ML models and APIs for production pipelines and training infrastructure.
• Collaborate with cross-functional teams to iterate on innovative solutions.

Skills

Research experience

Python programming

Multimodal ML

Education

PhD or MS in CS/Engineering

Job description

Apple Inc. is seeking a Multimodal AI applied scientist to drive multimodal scene understanding and human-centric device interaction.

You will develop multimodal LLMs to perceive environments and understand user behaviors, preferences, and interactions, spanning architecture design, model training, and deployment. You will work on assembling robust ML models and APIs that fit into Apple’s production pipelines, collaborating across teams to push the boundaries of foundation models and real-time