Senior Software Engineer, Robotics Foundation Models

NVIDIA; Santa Clara (CA); On-site; USD 148,000 - 288,000; Full time

Job summary

A leading tech company is seeking a robotics foundation model expert to advance AI in humanoid robots. You will design algorithms, deploy them on robots, and collaborate with teams to innovate in geometric computer vision. This role offers a competitive salary and benefits, making it a great opportunity for those passionate about AI and robotics.

Qualifications

• 5+ years of experience in algorithm development or research.
• Experience training vision-foundation models including 3D-VLMs and CLIP.

Responsibilities

• Conduct applied research and design innovative algorithms.
• Deploy algorithms on real humanoid robots.
• Collaborate across multiple engineering and research teams.

Skills

Algorithm Development

Communication

Collaboration

Deep Learning

C++

Python

Education

Masters in Computer Science

Ph.D. in Computer Science

Tools

TensorFlow

PyTorch

Job description

We are in the midst of a revolution where artificial intelligence is helping us accelerate all aspects of our lives. NVIDIA's mission is to accelerate this revolution. By combining NVIDIA's strengths in simulation (Omniverse), world models (Cosmos), foundation models (GR00T), and compute, we strive to bring general intelligence to humanoid robots. The Isaac team is looking for a robotics foundation model expert to help with this revolution. In this role, you will be working on imbuing humanoid robots with natural language intelligence, semantic understanding, and geometric awareness. Come join us to push the boundaries of robotics and enable the next generation of robotics!

What you’ll be doing:

1. Conduct applied research and design innovative algorithms in the space of geometric computer vision and image/video/vision-language/vision-centric foundation models.
2. Deploy algorithms on real humanoid robots to evaluate sim-to-real transfer of models.
3. Collaborate across multiple engineering and research teams to enable foundation models on humanoid robots.
4. Continuously learn and explore unfamiliar technologies.

What We Need To See:

• Masters in Computer Science, Robotics, Deep Learning, or related fields (or equivalent experience).
• 5+ years of experience in algorithm development or research relevant to vision-language models, foundation models, 3D-LLMs, video generative models, diffusion algorithms, or action-based transformers.
• Experience training vision-foundation models including 3D-VLMs, ViT, LLaVA, CLIP, diffusion models, and VLMs.
• Hands-on experience with deep learning frameworks (e.g., TensorFlow, PyTorch) and modern software development practices (version control, testing, CI/CD).
• Experience deploying algorithms on real-world robotic systems.
• Excellent communication skills and ability to collaborate effectively in cross-functional, distributed teams.
• Proficiency in C++ and Python.
• A strong desire and ability to learn and adapt to new technologies.

Ways To Stand Out From The Crowd:

• Ph.D. in Computer Science, Robotics, Deep Learning, or related fields.
• Publications in top-tier AI conferences or contributions to open-source projects.
• Experience with vision-language-action models.

With a competitive salary package and benefits, NVIDIA is considered one of the most desirable employers in the tech industry. We have some of the most forward-thinking and hardworking people working for us. Are you a creative and autonomous GenAI Engineer who loves challenges? Do you have a passion for advancing AI & machine learning across industries? If so, we want to hear from you.

The base salary range is $148,000 - $287,500, determined by location, experience, and similar roles. You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to diversity and is an equal opportunity employer. We value diversity in our current and future employees and do not discriminate based on race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability, or any other characteristic protected by law.