Senior Software Engineer, Robotics Foundation Models

Nvidia Corporation in; Santa Clara (CA); On-site; USD 130,000 - 170,000; Full time

Job summary

Join a leading company at the forefront of AI and robotics as a Senior Software Engineer. You will work on cutting-edge foundation models to enhance humanoid robots with natural language intelligence and geometric awareness. Collaborate with diverse teams, conduct innovative research, and deploy algorithms on robotic systems. This role offers an exciting opportunity to push the boundaries of robotics and contribute to the next generation of technology.

Qualifications

• 5+ years of relevant experience in algorithm development or research.
• Hands-on experience deploying algorithms on robotic systems.

Responsibilities

• Conduct applied research and design innovative algorithms in geometric computer vision.
• Deploy algorithms on real humanoid robots to evaluate sim-to-real transfer.

Skills

Algorithm Development

Communication

Collaboration

Deep Learning

Robotics

Education

Masters in Computer Science

Ph.D. in Computer Science

Tools

TensorFlow

PyTorch

C++

Python

Job description

Senior Software Engineer, Robotics Foundation Models (Finance)

We are in the midst of a revolution where artificial intelligence is helping us accelerate all aspects of our lives. NVIDIA's mission is to accelerate this revolution. By combining NVIDIA's strengths in simulation (Omniverse), world models (Cosmos), foundation models (GR00T), and compute, we strive to bring general intelligence to humanoid robots. The Isaac team is looking for a robotics foundation model expert to help with this revolution. In this role, you will work on imbuing humanoid robots with natural language intelligence, semantic understanding, and geometric awareness. Join us to push the boundaries of robotics and enable the next generation of robotics!

What you'll be doing:

1. Conduct applied research and design innovative algorithms in geometric computer vision and image/video/vision-language/vision-centric foundation models.
2. Deploy algorithms on real humanoid robots to evaluate sim-to-real transfer of models.
3. Collaborate across multiple engineering and research teams to enable foundation models on humanoid robots.
4. Continuously learn and explore new technologies.

What We Need To See:

1. Masters in Computer Science, Robotics, Deep Learning, or related fields (or equivalent experience).
2. 5+ years of relevant experience in algorithm development or research, particularly in areas such as Vision-language models, Foundation Models, 3D-LLMs, Video generative models, diffusion algorithms, or Action-based transformers.
3. Experience in training vision-foundation models including 3D-VLMs, ViT, LLaVA, CLIP, Diffusion, and VLMs.
4. Proficiency with deep learning frameworks (e.g., TensorFlow, PyTorch) and modern software practices (version control, testing, CI/CD).
5. Hands-on experience deploying algorithms on robotic systems.
6. Excellent communication skills and ability to collaborate in a cross-functional, distributed team.
7. Proficiency in C++ and Python.
8. Strong desire and ability to learn new technologies.

Ways To Stand Out From The Crowd:

1. Ph.D. in Computer Science, Robotics, Deep Learning, or related fields.
2. Publications in top-tier AI conferences or contributions to open-source projects.
3. Experience with vision-language-action models.

With a competitive salary and benefits, NVIDIA is a highly desirable employer. We value diversity and are committed to equal opportunity employment. We welcome applicants from all backgrounds to apply.