Senior 3D Spatial AI Engineer — Data Engine & Evaluation

NVIDIA AI; Santa Clara (CA); On-site; USD 224,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA in Santa Clara, CA, seeks a Senior Deep Learning Engineer to own the 3D data engine and end-to-end training verification for 3D spatial reasoning in Cosmos Lab. You will build scalable annotation pipelines, ensure data quality, and validate training pipelines across large GPU clusters.

You will collaborate with researchers to turn 3D hypotheses into measurable model improvements, contributing to VR/robotics and embodied AI benchmarks.

Qualifications

• MS or PhD in Computer Science, Electrical/Computer Engineering, Robotics, or related field, or equivalent experience.
• 12+ years of proven experience building deep learning systems in Python with PyTorch or JAX on Linux.
• Deep expertise in 3D computer vision, multi-view geometry, structure-from-motion or SLAM, depth and camera pose estimation, point cloud processing, or 3D reconstruction.
• Hands-on experience with vision-language models, including building the training data and evaluations that measurably improve visual grounding and reasoning quality.
• Demonstrated experience building large-scale multimodal data pipelines: distributed video and image processing, deduplication, captioning and annotation, automated quality metrics, and dataset versioning.
• Experience running and validating large model training on multi-GPU, multi-node clusters, with distributed training and sharding strategies (data, tensor, pipeline, or FSDP).
• Rigorous evaluation methodology: designing benchmarks, clean ablations, and honest result interpretation.

Responsibilities

• Own the 3D data engine for Cosmos spatial reasoning, curate large-scale real-world corpora for training data.
• Build annotation and auto-labeling pipelines for 3D-grounded supervision and 3D reference frames.
• Oversee data quality end-to-end: deduplication, quality scoring, coverage analysis, sampling strategies.
• Verify end-to-end model training: run pre-training and fine-tuning, ensure reproducibility.
• Develop 3D and spatial evaluation suites and benchmarks, with traceability to data and configurations.
• Collaborate with Cosmos Lab researchers to translate hypotheses into dataset experiments.
• Optimize multi-node GPU training, tuning throughput and dataloader performance.
• Release results in Cosmos, open datasets, and benchmarks, advancing data rigor.

Skills

Deep learning systems

Python PyTorch

JAX

Linux

Multimodal data pipelines

Distributed training

Evaluation benchmarks

Communication

Education

MS or PhD in CS/EE/Robotics

Tools

PyTorch

JAX

Ray

Spark

Slurm

Job description

NVIDIA in Santa Clara, CA, seeks a Senior Deep Learning Engineer to own the 3D data engine and end-to-end training verification for 3D spatial reasoning in Cosmos Lab. You will build scalable annotation pipelines, ensure data quality, and validate training pipelines across large GPU clusters.

You will collaborate with researchers to turn 3D hypotheses into measurable model improvements, contributing to VR/robotics and embodied AI benchmarks.