Senior Vision-Language Model Engineer: Multimodal AI

Unknown; Myrtle Point (OR); On-site; USD 184,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA seeks a senior vision language model engineer to design and build agentic data and training workflows for Autonomous Vehicles, Robotics, and Medical applications. You will collaborate with researchers to prototype VLMs/VLAs and contribute to NVIDIA Cosmos Dataset Search.

You will curate multimodal datasets, explore synthetic data sources, and integrate pipelines into production codebases while staying current with state-of-the-art in deep learning and agentic AI workflows.

Qualifications

• PhD with 4+ years, MS with 6+ years, or BS with 8+ years in CS/CE or a related field.
• Strong background in modern deep learning, including transformer-based architectures, video modeling, and multimodal VLM/VLA or foundation models.
• Experience training and deploying deep learning models on real-world datasets: preprocessing, distributed training, evaluation, debugging, and iterative improvement.
• Experience with Python and at least one deep learning framework.
• Up-to-date with research on image/video search for autonomous vehicles, healthcare, robotics, or related Physical AI apps.
• Proficiency with agentic AI workflows across the research lifecycle, prototyping algorithms, search pipelines, and production integration.
• Clear communication skills and ability to collaborate in a dynamic, product- and research-focused team.

Responsibilities

• Partner with researchers to develop and evaluate prototypes of latest models (VLMs/VLAs) for video search and understanding.
• Enable advances in autonomous driving, healthcare, and robotics.
• Design and implement agentic data workflows to automate data discovery, labeling, evaluation, and retraining.
• Build, curate, and maintain multimodal datasets (video, sensor, language traces) for end-to-end AI problems.
• Explore and productize new data sources including simulation and synthetic data.
• Apply agentic AI workflows across the applied research lifecycle.
• Collaborate with research, model development, performance, and product teams; contribute to NVIDIA Cosmos Dataset Search.

Skills

Deep learning

Transformer models

Video modeling

Multimodal VLM

Foundation models

Python

DL frameworks

Communication

Education

PhD +4+ yrs

MS +6+ yrs

BS +8+ yrs

Job description

NVIDIA seeks a senior vision language model engineer to design and build agentic data and training workflows for Autonomous Vehicles, Robotics, and Medical applications. You will collaborate with researchers to prototype VLMs/VLAs and contribute to NVIDIA Cosmos Dataset Search.

You will curate multimodal datasets, explore synthetic data sources, and integrate pipelines into production codebases while staying current with state-of-the-art in deep learning and agentic AI workflows.