JPL Postdoctoral: Edge Vision Language Models and Foundation Models

Jet Propulsion Laboratory; United States; On-site; USD 75,000 - 92,000; Full time

Job summary

Jet Propulsion Laboratory seeks a Postdoctoral scholar to advance edge Vision Language Models and Foundation models for embedded deployment. You will work on deploying and fine‑tuning models on devices like Nvidia NX/AGX, and develop segmentation, YOLO, and open vocabulary detection heads while shaping evaluation methods.

The role emphasizes publishing results, presenting at conferences, and collaborating with JPL advisors over a one‑year minimum with potential renewal up to three years.

Qualifications

• Ph.D. in Computer Science, Artificial Intelligence, Computer Vision, Robotics, or a closely related field.
• Research expertise in one or more of Vision Language Models, Foundation models, or embedded AI.
• Experience deploying AI algorithms and models to embedded platforms (e.g., Nvidia NX, AGX).
• Hands-on experience with fine-tuning techniques (LoRA, SFT) and working with multiple vision heads (segmentation, YOLO, open vocabulary object detection).
• Experience with evaluation and benchmark pipelines, specifically involving LLM-driven evaluation.
• Demonstrated record of peer-reviewed scientific publications.

Responsibilities

• Conduct research in edge Vision Language Models (VLMs) and Foundation models.
• Deploy complex foundation models to embedded platforms (e.g., Nvidia NX, AGX).
• Fine-tune foundation models using LoRA and SFT techniques.
• Develop and integrate multiple vision heads for tasks including segmentation, object recognition, and open vocabulary detection.
• Design, implement, and run evaluation and benchmark pipelines, including LLM-driven evaluation methodologies.
• Publish research results in peer-reviewed journals and present results at scientific conferences.

Skills

Vision Language Models

Foundation models

Embedded AI

LoRA

SFT

Benchmark pipelines

YOLO

Education

Ph.D. in CS/AI/CV/Robotics

Tools

NVIDIA NX

NVIDIA AGX

Job description

About JPL

New ideas are all around us, but only a few will change the world. That’s our focus at JPL. We ask the biggest questions, then search the universe for answers—literally. We build upon ideas that have guided generations, then share our discoveries to inspire generations to come. Your mission—your opportunity—is to seek out the answers that bring us one step closer. If you’re driven to discover, create, and inspire something that lasts a lifetime and beyond, you’re ready for JPL. Located in Pasadena, California, JPL has a campus‑like environment situated on 177 acres in the foothills of the San Gabriel Mountains and offers a work environment unlike any other: we inspire passion, foster innovation, build collaboration, and reward excellence.

Position Overview

We are recruiting a Postdoctoral scholar to conduct research in edge Vision Language Models and Foundation models. The successful candidate will play a key role in advancing the deployment and capabilities of state‑of‑the‑art AI on edge devices. See more information at https://ai.jpl.nasa.gov.

Responsibilities

• Conduct research in edge Vision Language Models (VLMs) and Foundation models.
• Deploy complex foundation models to embedded platforms (e.g., Nvidia NX, AGX, and others).
• Fine‑tune foundation models using techniques such as LoRA (Low‑Rank Adaptation) and SFT (Supervised Fine‑Tuning).
• Develop and integrate multiple vision heads for tasks including segmentation, object recognition (e.g., YOLO), and open vocabulary object detection.
• Design, implement, and run evaluation and benchmark pipelines, including LLM‑driven evaluation methodologies.
• Publish research results in peer‑reviewed journals and present results at scientific conferences.

Required Qualifications

• Ph.D. in Computer Science, Artificial Intelligence, Computer Vision, Robotics, or a closely related field.
• Research expertise in one or more of the following: Vision Language Models, Foundation models, or embedded AI.
• Experience deploying AI algorithms and models to embedded platforms (e.g., Nvidia NX, AGX).
• Hands‑on experience with fine‑tuning techniques (LoRA, SFT) and working with multiple vision heads (segmentation, YOLO, open vocabulary object detection).
• Experience with evaluation and benchmark pipelines, specifically involving LLM‑driven evaluation.
• Demonstrated record of peer‑reviewed scientific publications.

Other Details

The appointee will carry out research in collaboration with JPL advisor, resulting in publications in the open literature. Applicants may be subject to additional program requirements by NASA. Postdoc positions are awarded for a minimum of one‑year period and may be renewed up to a maximum of three years.

Benefits

JPL has a catalog of benefits and perks that span from the traditional to the unique. This includes a variety of health, dental, vision, wellbeing, and retirement plans, paid time off, learning, rideshare, childcare, flexible schedule, parental leave and many more. Our focus is on work‑life balance, and living healthy, fulfilling lives as we Dare Mighty Things Together. For benefits eligible positions, benefits are effective the first day of the month coincident with or immediately following the employee’s start date.

Salary

$83,820 - $83,820

EEO & Equal Opportunity

JPL is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to sex, race, color, religion, national origin, citizenship, ancestry, age, marital status, physical or mental disability, medical condition, genetic information, pregnancy or perceived pregnancy, gender, gender identity, gender expression, sexual orientation, protected military or veteran status or any other characteristic or condition protected by Federal, state or local law. In addition, JPL is a VEVRAA Federal Contractor. EEO is the Law. EEO is the Law Supplement Pay Transparency Nondiscrimination Provision. Due to rules imposed by NASA, JPL will not accept applications from citizens of designated countries or those born in a designated country unless they are U.S. Citizens, Legal Permanent Residents of the U.S or have other protected status under 8 U.S.C. 1324b(a)(3). The Designated Countries List is available here.

Company Overview

Formed in 1936, the NASA Jet Propulsion Laboratory is a federally funded research and development center managed for NASA by the California Institute of Technology (Caltech.). JPL joined NASA as an FFRDC when the agency was founded in 1958. JPL helped open the Space Age by developing America’s first Earth‑orbiting science satellite, creating the first successful interplanetary spacecraft, and sending robotic missions to the solar system. Today JPL continues its world‑leading innovation, implementing programs in planetary exploration, Earth science, space‑based astronomy and technology development while applying its capabilities to technical and scientific problems of national significance. Above all, we are explorers. At JPL we promote collaboration, innovation, integrity, and excellence in distinct academic areas. We turn ideas for science investigation into the reality of groundbreaking space missions, partnering with our strategic business teams to guide JPL into the future.