Research Scientist Intern, Foundation Model Optimization (PhD)

Meta

Burlingame (CA)

On-site

USD 85,000 - 141,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Meta's Reality Labs seeks a Research Scientist Intern to advance language and vision model optimization for on-device deployment on AR/VR/MR/SG devices. You will conduct LLM and foundation model research aimed at publications in top CV/NLP/ML venues and develop optimization algorithms and infrastructure for resource-constrained environments.

The role involves collaboration across device and cloud teams, with emphasis on personalization, model compression and omni-modal architectures while

Qualifications

  • Pursuing a PhD in AI or related field.
  • Must obtain work authorization at time of hire and maintain it during employment.
  • Hands-on experience with deep learning algorithms and transformers.
  • Experience with PyTorch/JAX and scripting languages (Python, shell).

Responsibilities

  • Conduct LLM and vision foundation model research leading to publications in top CV/NLP/ML conferences.
  • Develop model optimization algorithms and infrastructure for deployment in mobile/AR/VR/MR/SG devices.
  • Explore joint optimization of models and the surrounding assistant system (planning, memory, tool use, coordination).
  • Investigate personalization, model compression and efficient inference, and omni-modal architectures.
  • Collaborate with cross-disciplinary research and engineering teams.

Skills

Deep learning
Transformers

Education

PhD in AI or related field

Tools

PyTorch
JAX
Python
Shell scripting

Job description

Meta's mission is to give people the power to build community and bring the world closer together, and the Meta Reality Labs organization focuses on delivering this vision through AR/VR/SG devices.Meta's Efficiency and On-Device AI team within the Reality Labs organization is seeking a Research Scientist Intern with a focus on language/vision model optimization. As a Research Scientist Intern, your primary objective is to develop cutting-edge efficient LLMs and vision foundation models.

Research Scientist Intern, Foundation Model Optimization (PhD) Responsibilities:
  • Perform LLM and vision foundation model research that leads to publications in top-tier CV/NLP/ML conferences.
  • Develop model optimization algorithms and infrastructure to enable deployment of models in resource-constrained settings, such as mobile phones and AR/VR/MR/SG devices.
  • Research joint optimization of models and the surrounding assistant system, including planning, memory, tool use, and coordination across device and cloud.
  • Explore personalization, model compression and efficiency, and novel model architectures including omni-modal capabilities.
  • Collaborate with cross-disciplinary research and engineering teams.
Minimum Qualifications:
  • Currently is in the process of obtaining a PhD in the field of Artificial Intelligence or related field
  • Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment
  • Hands-on experience in deep learning algorithms and techniques, e.g., transformers
  • Experience with deep learning software libraries such as PyTorch/JAX
  • Experience with scripting languages such as Python and shell scripts
Preferred Qualifications:
  • Intent to return to degree-program after the completion of the internship
  • Experience with large scale foundation model training and on-device foundation model optimization
  • Experience in one or more of: LLM agents and orchestration, personalization, model compression and efficient inference, efficient model architectures, multi-modal modeling, data-centric approaches for model tuning and evaluation
  • Proven track record of publications at CV/NLP/ML conferences/journals such as NeurIPS, ICLR, ICML, CVPR, ICCV, ECCV, AAAI, ACL, EMNLP
About Meta:

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.

Meta is proud to be an Equal Employment Opportunity and Affimitive Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@meta.com.

$7,650/month to $12,667/month + benefits

Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Scientist Intern, FAIR - Multimodal Foundations (PhD)
Research Scientist Intern, FAIR - Multimodal Foundations (PhD)

Meta • San Francisco (CA)

On-site
USD 85,000 - 141,000
Benefits
Research Scientist Intern, FAIR - Multimodal Foundations (PhD)
Research Scientist Intern, FAIR - Multimodal Foundations (PhD)

Meta • Menlo Park (CA)

On-site
USD 85,000 - 141,000
Research Scientist Intern, AI Agents and Machine Learning (PhD)
Research Scientist Intern, AI Agents and Machine Learning (PhD)

Meta • Menlo Park (CA)

On-site
USD 85,000 - 141,000
Research Scientist Intern, Spatial Reasoning & Localization (PhD)
Research Scientist Intern, Spatial Reasoning & Localization (PhD)

Meta • Boston (MA)

On-site
USD 85,000 - 141,000
Equal employment opportunity
Accommodation support
Research Scientist Intern, AI Alignment
Research Scientist Intern, AI Alignment

Meta • Seattle (WA)

On-site
USD 85,000 - 141,000
Research Scientist Intern, Meta Recommendation Systems (PhD)
Research Scientist Intern, Meta Recommendation Systems (PhD)

Meta • Menlo Park (CA)

On-site
USD 85,000 - 141,000
Research Scientist Intern, Monetization Ranking & AI Foundations (PhD)
Research Scientist Intern, Monetization Ranking & AI Foundations (PhD)

Meta • Sunnyvale (CA)

On-site
USD 85,000 - 141,000
Research Scientist Intern, Meta Recommendation Systems - Core ML (PhD)
Research Scientist Intern, Meta Recommendation Systems - Core ML (PhD)

Meta • Bellevue (WA)

On-site
USD 85,000 - 141,000
AI Research Scientist Intern, Neural Interfaces(PhD)
AI Research Scientist Intern, Neural Interfaces(PhD)

Meta • New York (NY)

On-site
USD 85,000 - 141,000
Benefits
Equal opportunity employer
Research Scientist Intern, Meta Recommendation Systems - Core ML (PhD)
Research Scientist Intern, Meta Recommendation Systems - Core ML (PhD)

Meta • Menlo Park (CA)

On-site
USD 85,000 - 141,000