Senior Research Scientist, Open-Source Multi-Modal LLMs

NVIDIA; Santa Clara (CA); On-site; USD 192,000 - 356,500; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking a Senior Research Scientist to advance multi-modal language models and push open-source efforts. You will drive model capabilities, design multi-modal training recipes, and collaborate with researchers to ship production-ready solutions.

The role emphasizes openness, open weights, and open data, with a focus on advancing state-of-the-art in multi-modal LLMs. Equity and strong benefits accompany the base compensation.

Qualifications

• PhD or equivalent research experience in LLMs, systems, or related areas.
• 4+ years of experience in computer vision, especially multi-modal LLMs.
• Proficiency in Python with hands-on PyTorch experience.
• Solid background in algorithms, data structures, parallel/distributed computing, and systems programming.
• Proven ability to collaborate across research and engineering teams.

Responsibilities

• Drive new abilities into the model.
• Improve generalization by addressing weak points and retraining.
• Develop training recipes for multi-modal data (text, image, video, audio).
• Design solutions to improve Pareto efficiency.
• Collaborate with researchers to translate ideas into production-ready implementations.
• Explore new evaluation paradigms.
• Demonstrate strong engineering practices and contribute to open-source communities.

Skills

Python

PyTorch

CS fundamentals

Collaboration across teams

Open-source contributions

Education

PhD in Computer Science, Electrical Engineering, or related field

Job description

NVIDIA is seeking a Senior Research Scientist to advance multi-modal language models and push open-source efforts. You will drive model capabilities, design multi-modal training recipes, and collaborate with researchers to ship production-ready solutions.

The role emphasizes openness, open weights, and open data, with a focus on advancing state-of-the-art in multi-modal LLMs. Equity and strong benefits accompany the base compensation.