Senior Software Engineer - Robotics Real2Sim Applications

Roboticsconnected; Santa Clara (CA); On-site; USD 152,000 - 242,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA's Isaac‑NuRec team is building neural reconstruction and Real2Sim systems that convert real-world sensor data into high-fidelity, simulation-ready environments for robotics simulation, learning, and deployment. You will own end-to-end pipelines transforming sensor streams into structured assets and environment representations for downstream robotic applications.

The Senior Systems Engineer will build dense 3D reconstruction systems, high-performance simulation workflows, and robotics

Qualifications

• BS, MS, or PhD in Computer Science, Electrical Engineering, Robotics, or related field (or equivalent experience).
• 5+ years in robotics systems, 3D vision, simulation, or closely related software engineering roles.
• Hands-on experience with neural 3D reconstruction, mesh/object reconstruction, or deep-learning–based 3D vision.
• Exposure to reinforcement or imitation learning workflows for robotic perception and control.
• Experience with ROS 2 and real-time constraints, plus familiarity with Isaac Sim, Isaac Lab, or MuJoCo.
• Proven ability to drive technical direction or architecture for complex robotics or 3D perception systems, with strong Python and C++ skills and experience shipping production-quality systems.

Responsibilities

• Build end-to-end Real2Sim pipelines ingest multi-modal sensor data (RGB/RGB-D, LiDAR, IMU) and produce high-fidelity scene and object representations for Isaac Sim.
• Develop neural 3D reconstruction systems and related 3D vision components to build digital twins of real-world environments and objects.
• Integrate reconstruction outputs with mapping, localization, and multi-sensor fusion systems for robust perception and navigation.
• Collaborate with ML researchers to integrate, deploy, and optimize workflows to enable training and validation in sim.
• Deploy and optimize reconstruction, data generation, and data augmentation pipelines at scale.
• Optimize, validate, and debug cross-stack systems spanning sensors, models, simulation, and downstream robot policies.
• Instrument and monitor production Real2Sim and reconstruction services, ensuring reliability, performance, and debuggability in large-scale deployments.

Skills

Robotics systems

3D vision

Simulation

Python

C++

ROS 2

Real-time constraints

Education

BS/MS/PhD in CS/EE/Robotics

Tools

MuJoCo

Isaac Sim

Isaac Lab

Job description

NVIDIA's Isaac‑NuRec team is building neural reconstruction and Real2Sim systems that turn real‑world sensor data into high‑fidelity, simulation‑ready environments and objects for robotics simulation, learning, and deployment. As a Senior Systems Engineer, you will build dense 3D reconstruction systems, high‑performance simulation workflows, and robotics software that bridge research innovations with production‑grade systems, owning end‑to‑end pipelines that transform sensor streams into structured assets and environment representations for downstream robotic applications. We are looking for strategic, ambitious, and creative individuals passionate about advancing the boundaries of robotics!

What you’ll be doing:

• Build end‑to‑end Real2Sim pipelines that ingest multi‑modal sensor data (RGB/RGB‑D, LiDAR, IMU) and produce high‑fidelity scene and object representations for Isaac Sim.

• Develop neural 3D reconstruction systems and related 3D vision components to build digital twins of real‑world environments and objects.

• Integrate reconstruction outputs with mapping, localization, and multi‑sensor fusion systems for robust perception and navigation.

• Collaborate with ML researchers to integrate, deploy, and optimize workflows to enable training and validation in sim.

• Deploy and optimize reconstruction, data generation, and data augmentation pipelines at scale.

• Optimize, validate, and debug cross‑stack systems spanning sensors, models, simulation, and downstream robot policies.

• Instrument and monitor production Real2Sim and reconstruction services, ensuring reliability, performance, and debuggability in large‑scale deployments.

What we need to see:

• BS, MS, or PhD in Computer Science, Electrical Engineering, Robotics, or related field (or equivalent experience).

• 5+ years in robotics systems, 3D vision, simulation, or closely related software engineering roles.

• Hands‑on experience with neural 3D reconstruction, mesh/object reconstruction, or deep‑learning–based 3D vision.

• Exposure to reinforcement or imitation learning workflows for robotic perception and control.

• Experience with ROS 2 and real‑time constraints, plus familiarity with Isaac Sim, Isaac Lab, or MuJoCo.

• Proven ability to drive technical direction or architecture for complex robotics or 3D perception systems, with strong Python and C++ skills and experience shipping production‑quality systems.

Ways to stand out from the crowd:

• Experience with neural scene representations (NeRF, 3D Gaussian Splatting, occupancy networks).

• Experience with object reconstruction and sim‑ready asset generation pipelines (for example, mesh extraction, material and collision setup, USD export).

• Familiarity with multi‑sensor fusion, sim‑to‑real transfer, and data augmentation workflows.

• Experience building or integrating agentic frameworks, including LLM/VLM‑based task planners, tool‑use pipelines, or multi‑step reasoning systems.

• Contributions to robotics or 3D vision open source, or publications at venues such as CVPR, ICCV, ICRA, RSS, or CoRL.

Your base salary will be determined based on your location, experience, and other objective job‑related factors. The expected base salary ranges for this position are:
152,000 USD – 241,500 USD for Level 3; and 184,000 USD – 287,500 USD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 6, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.