Senior Multimodal AI Scientist — Agentic RL

NVIDIA Corporation; Santa Clara (CA); On-site; USD 184,000 - 288,000; Full time

Job summary

NVIDIA is seeking Senior Deep Learning Scientists to advance multimodal AI and large language models for agentic systems. You will apply core and applied research to train, fine-tune, and deploy models spanning audio-visual reasoning, tool usage, and document understanding.

You’ll drive post-training alignment, RLHF/RLVR/MOPD methods, and evaluate data pipelines and benchmarks. This role focuses on scaling innovative multimodal AI on Nemotron Omni and VoiceChat platforms at a global tech leader

Qualifications

• Master’s degree (or equivalent experience) or PhD in Computer Science, AI, or Applied Math with 8+ years of relevant work experience.
• Excellent programming skills in Python with strong fundamentals in scalable model development and PyTorch.
• Strong knowledge of ML/DL techniques and modern foundation model architectures, including Transformers and mixture-of-experts models.
• Foundational understanding of reinforcement learning algorithms and implementation, including MDPs, policies, and reward design.
• Hands-on experience in post-training multimodal models for audio-visual reasoning, full-duplex voice chat, and human-AI interaction.
• Proven ability to manage model development life cycles, including dataset versioning, experiment tracking, and evaluation pipelines.

Responsibilities

• Apply fundamental and applied research to develop, train, fine-tune, and deploy large language models for agentic systems encompassing audio-visual reasoning, tool usage, and document understanding.
• Advance post-training and alignment methods including instruction tuning, preference optimization, and RLHF/RLVR/MOPD to improve multimodal agents for complex use cases.
• Research and develop agentic reasoning and grounded perception capabilities, focusing on planning, tool execution, and long-horizon task completion across digital and physical environments.
• Lead the collection, development, and benchmarking of multimodal datasets, ensuring high-quality evaluation of model accuracy, safety, and task completion success.

Skills

Python

PyTorch

Machine learning

Deep learning

Transformers

RL algorithms

Experiment tracking

Dataset versioning

Education

Master’s or PhD in CS/AI/Applied Math

Job description

NVIDIA is seeking Senior Deep Learning Scientists to advance multimodal AI and large language models for agentic systems. You will apply core and applied research to train, fine-tune, and deploy models spanning audio-visual reasoning, tool usage, and document understanding.

You’ll drive post-training alignment, RLHF/RLVR/MOPD methods, and evaluate data pipelines and benchmarks. This role focuses on scaling innovative multimodal AI on Nemotron Omni and VoiceChat platforms at a global tech leader