Multimodal LLM Architect & Research Engineer

Apple Inc.; United States; On-site; USD 180,000 - 240,000; Full time

Job summary

Apple's System Intelligence and Machine Learning (SIML) team is seeking a Multimodal AI applied scientist to drive the future of multimodal scene understanding and human-centric device interaction. You will design, train, and deploy large-scale multimodal LLMs and build APIs for production-ready models within Apple’s training infrastructure.

You will work across the full lifecycle, enabling human-centric experiences and scalable ML deployments while collaborating with cross-functional teams in a

Qualifications

• PhD or MS in Computer Science, Engineering, or related field with a focus on machine learning.
• First author publications in top-tier ML conferences.
• Expert knowledge of SOTA in large auto-regressive transformer models, multi-modal encoders, and representation learning.
• Experience with multimodal large language models (LLMs).
• Strong Python programming skills and ML codebase discipline.
• Proven track record of deploying innovative ML technologies in production.
• Familiarity with ML for resource-constrained devices.
• Experience working with cross-functional and diverse teams.

Responsibilities

• Design, train, and deploy large-scale multimodal LLMs, owning the lifecycle from architecture to deployment.
• Implement and demonstrate novel, human-centric experiences using the capabilities of large foundation models.
• Create robust, scalable ML models and APIs that integrate into production pipelines and training infrastructure.
• Work closely with partner teams to build, iterate, and adapt innovative solutions in a dynamic, product-focused environment.

Skills

Transformer models

Multimodal encoders

Representation learning

Multimodal LLMs

Python

Cross-functional teams

Research publications

ML deployment

Education

PhD or MS in CS/Engineering with ML focus

Machine Learning PhD

Job description

Apple's System Intelligence and Machine Learning (SIML) team is seeking a Multimodal AI applied scientist to drive the future of multimodal scene understanding and human-centric device interaction. You will design, train, and deploy large-scale multimodal LLMs and build APIs for production-ready models within Apple’s training infrastructure.

You will work across the full lifecycle, enabling human-centric experiences and scalable ML deployments while collaborating with cross-functional teams in a