Senior Software Engineer, Spatial Intelligence and Foundation Models

NVIDIA

United States

On-site

USD 184,000 - 357,000

Full time

6 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Benefits

Job summary

NVIDIA Corporation is seeking a Software Engineer for the Isaac Spatial Intelligence team within Isaac Engineering. You will develop perception systems turning sensor data into actionable world understanding for robots, spanning robotics, simulation, and large-scale data pipelines.

Responsibilities include SLAM, structure-from-motion, optical flow, and training vision-language models, collaborating across teams to deploy capabilities on physical robots and in simulations, with equity and

Qualifications

  • PhD or Master’s degree in CS/Robotics or related field.
  • 8+ years of experience in computer vision, robotics, or deep learning.
  • Strong foundation in 3D geometric computer vision (multi-view geometry, VO/SLAM, SfM, dense correspondence).
  • Hands-on programming in Python and/or C++; experience with DL frameworks (PyTorch, JAX, TensorFlow).
  • Experience training/evaluating DL models for perception; familiarity with vision-language models is a plus.
  • Proficiency with AI coding agents/tools to accelerate development, testing, and experimentation.

Responsibilities

  • Design, implement, and deploy novel spatial understanding algorithms (SLAM, SfM, optical flow, etc.).
  • Develop perception, mapping, and reasoning systems for robots, simulations, and data pipelines.
  • Advance 3D vision research by combining classical geometry with deep learning.
  • Train/evaluate vision-language models for robotics tasks.
  • Collaborate with cross-functional teams to deploy capabilities on robots and simulations.
  • Contribute to prototypes, open-source software, patents, and publications.

Skills

Robotics
Computer Vision
Deep Learning
Python

Education

PhD or Master’s in CS/Robotics

Tools

Python
C++
PyTorch
JAX
TensorFlow

Job description

NVIDIA is seeking a Software Engineer to join our Isaac Spatial Intelligence team within the Isaac Engineering org! You will join a group of world-class robotics software and applied research engineers focused on geometric and semantic understanding, and reasoning for robots - building the perception systems that turn raw sensor data into actionable world understanding, shaping the future of physical AI!

What you'll be doing:
  • Design, implement, and deploy novel algorithms for spatial understanding, working on problems ranging from SLAM, structure-from-motion, optical flow, scene flow, and object reconstruction to training VLMs on a wide range of spatial reasoning skills.
  • Develop robust perception, mapping, and reasoning systems that run on robots, in simulation, and at scale in data pipelines for training foundation models.
  • Advance the state of the art in geometric computer vision, combining classical multi-view geometry and optimization with modern deep learning approaches.
  • Train and evaluate vision-language models on skills relevant to robotics.
  • Work closely with the Cosmos and GR00T teams on perception and spatial understanding for foundation models and collaborate with other Isaac teams including Sim/Lab, Platform and SQA to deploy, validate, extend and release capabilities & features on physical robots as well as in at-scale simulations.
  • Contribute to the effective integration, validation, and release of applied research efforts in collaboration with research teams and on top of NVIDIA's advanced robotics platforms.
  • Foster a culture of innovation and collaboration, supporting deliverables such as prototypes, open source software contributions, patents, and publications.
  • Collaborate cross-functionally with product, hardware, and software teams to translate engineering work into impactful products.
What we need to see:
  • PhD or Master's degree in Computer Science, Robotics, or a related field (or equivalent experience).
  • 8+ years of experience working on computer vision, robotics, or deep learning technologies.
  • Strong foundation in 3D geometric computer vision: multi-view geometry, visual odometry/SLAM, structure-from-motion, or dense correspondence (optical flow, scene flow, stereo).
  • Strong hands-on programming skills in Python and/or C++; experience with Deep Learning frameworks (PyTorch, JAX, TensorFlow).
  • Experience training and evaluating deep learning models for perception tasks; familiarity with vision-language models is a strong plus.
  • Strong skills in agentic tool use - proficiency working with AI coding agents and agentic workflows (e.g., Claude Code, Cursor, Codex) to accelerate development, testing, and experimentation.
  • Excellent communication, organizational, and interpersonal skills.
Ways to stand out from the crowd:
  • Contributions to widely used SLAM, SfM, or 3D reconstruction systems (open source or shipped products).
  • Experience with large-scale model training on GPU clusters, including VLMs or other foundation models.
  • Publications at top computer vision or robotics venues (CVPR, ICCV, ECCV, ICRA, IROS, RSS, CoRL).
  • Hands-on experience with simulation-based training and evaluation, sim-to-real and real-to-sim transfer.

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:

  • 184,000 USD - 287,500 USD for Level 4; and 224,000 USD - 356,500 USD for Level 5.

You will also be eligible for equity and benefits .

Applications for this job will be accepted at least until November 3, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer, Spatial Intelligence and Foundation Models
Senior Software Engineer, Spatial Intelligence and Foundation Models

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Senior Deep Learning Engineer, Cosmo 3D Spatial
Senior Deep Learning Engineer, Cosmo 3D Spatial

NVIDIA • Santa Clara (CA)

On-site
USD 224,000 - 357,000
Equity
Benefits
Robotics Research Engineer - Robot Simulation and Evaluation
Robotics Research Engineer - Robot Simulation and Evaluation

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior Software Engineer - Robotics Real2Sim Applications
Senior Software Engineer - Robotics Real2Sim Applications

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 152,000 - 288,000
Equity
Senior Robotics Systems Engineer - Neural Reconstruction and Real2Sim Applications
Senior Robotics Systems Engineer - Neural Reconstruction and Real2Sim Applications

NVIDIA • United States

On-site
USD 152,000 - 288,000
Equity
Benefits
Developer Relations Manager Robotics
Developer Relations Manager Robotics

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 152,000 - 288,000
Senior Software Engineer, Metropolis Vision AI
Senior Software Engineer, Metropolis Vision AI

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 224,000 - 357,000
Equity
Benefits
Senior Software Engineer, Humanoid Robotics
Senior Software Engineer, Humanoid Robotics

NVIDIA • Santa Clara (CA)

On-site
USD 152,000 - 288,000
Equity
Benefits
Senior Applications Software Engineer, Perception and Sensor Fusion
Senior Applications Software Engineer, Perception and Sensor Fusion

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 152,000 - 288,000
Equity
Benefits
Senior Software Engineer - Robotics Real2Sim Applications
Senior Software Engineer - Robotics Real2Sim Applications

Roboticsconnected • Santa Clara (CA)

On-site
USD 152,000 - 242,000
Equity
Benefits