Director, System Software Engineering - Metropolis Accelerated and Inferencing Software

NVIDIA AI

Santa Clara (CA)

On-site

USD 320,000 - 488,750

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

NVIDIA is a world leader in AI technologies and scalable GPU-accelerated video intelligence systems. We seek a senior engineering leader who will guide global teams, drive end-to-end data inference acceleration, and shape framed architectures for Metropolis and Vision AI projects.

You will collaborate across continents, oversee DL model deployment, and contribute to strategic customer engagements. A strong track record in leadership and deep ML/DL expertise is essential for this role.

Qualifications

  • Bachelor's and/or Master's in Computer Science/Electrical Engineering or equivalent experience.
  • 15+ years of overall experience, with a minimum of 10+ years of ML/DL research or practical experience, plus 7+ years in leadership.
  • Over 10 years of experience in embedded software with production-grade responsibilities.
  • Deep knowledge of GPU, CPU, and DL architecture fundamentals, plus low-level performance optimizations.
  • Hands-on experience with VLMs/LLMs or multimodal AI systems in perception or data triage.

Responsibilities

  • Lead and develop engineering and data teams across regions.
  • Architect and operationalize end-to-end data inference acceleration strategies.
  • Drive implementations of TensorRT and other frameworks for edge and enterprise devices.
  • Collaborate with Metropolis OEMs and partners to design accelerated DL models and inference pipelines.
  • Provide direct customer support and draft final SOWs with internal teams.
  • Benchmark performance on industry standards and guide improvements.
  • Act as a technical leader across multiple teams, shaping SOC/GPU DL hardware.
  • Scale the team through hire and mentoring to meet DL challenges.
  • Represent NVIDIA Deep Learning solutions at webinars and events.

Skills

Leadership
Deep Learning
Communication
Strategic planning
Mentoring
Technical leadership

Education

Bachelor's or Master's in CS/EE

Tools

VLMs/LLMs
TensorRT
GPU/CPU architecture

Job description

Job Requisition ID

JR2011299

Job Category

Engineering

Time Type

Full time

NVIDIA is a world leader in physical AI, powering self-driving cars, humanoid robots, intelligent environments, medical devices, and more. Our software platforms are at the core of this mission, enabling innovators to build world-changing products that save lives, improve working conditions, and elevate living standards across the globe. This team is the execution engine behind NVIDIA’s Vision AI strategy—owning the full lifecycle from model onboarding to production deployment. We transform foundation models into real-time, GPU-accelerated video intelligence systems using DeepStream and VSS. Our focus is on scaling multimodal reasoning, enabling agentic development workflows, and closing the loop between production data and model improvement—positioning NVIDIA as the default platform for Physical AI.

What You'll Be Doing
  • Lead, encourage, and develop world-class engineering and data teams decentralized across Europe, Asia, and the United States.
  • Architect and operationalize NVIDIA’s end-to-end data Inference Acceleration strategy, powering inference and continuous performance improvements.
  • Drive strategic implementations of TensorRT, VLLM, and other accelerated frameworks for inference solutions for Edge and Enterprise devices: Lead Accelerated Computing efforts and solutions for key Metropolis verticals. Set up Proofs of Readiness (PORs) and guide their implementations.
  • Collaborate with major Metropolis OEMs and Partners to architect highly accelerated and optimized custom deep learning models and inference pipelines for their specific requirements.
  • Offer direct customer support, including debugging, technical education, and handling customer inquiries for our Metropolis partner and customers. Responsible for drafting and finalizing SOWs with internal customers and partners.
  • Performance Benchmarking: Orchestrate efforts to achieve leading performance results on industry benchmarks like MLPerf on various edge and Enterprise devices.
  • Technical Leadership & Influence: Function as a technical leader for deep learning across multiple teams, giving oversight and building support. Apply customer insights to shape the composition and structure of upcoming SOC/GPU deep-learning hardware.
  • Scaling the Team: Strategically hiring to meet new demands while also mentoring and adjusting existing teams to new deep learning challenges.
  • Represent Nvidia Deep Learning solutions in webinars, conferences, and partner events
What We Need To See
  • Bachelor's and/or Master's in Computer Science/Electrical Engineering or equivalent experience.
  • 15+ years of overall experience, with a minimum of 10+ years of meaningful involvement in machine learning/deep learning research or practical experience, coupled with 7+ years of leadership background.
  • Over 10 years of validated industry expertise in the embedded software sector, holding technical leadership positions accountable for delivering outstanding production software within a multifaceted setting.
  • Deep knowledge of GPU, CPU, and dedicated deep-learning architecture fundamentals, and low-level performance optimizations using heterogeneous computing.
  • Hands-on experience with VLMs, LLMs, or multimodal AI systems applied to perception, data triage, or automated labeling.
  • Strong expertise in large-scale data processing, systems building, or machine learning pipelines.
  • Strong communication, careful planning, and technical leadership capabilities.
Ways To Stand Out From The Crowd
  • PhD in a relevant field such as Spatial Computing & Awareness, Sim-to-Real Transfer, Human-to-Physical AI Interaction,
  • Deep experience with CV, LLMs, VLMs, GenAI models, and standards.
  • Technical thought leadership in production deployment of Smart Spaces, Physical AI, with a deep understanding of constraints and advancements of sensing, computing, and model architecture evolutions.
  • Current experience leading and driving global teams across multiple continents and time zones

With competitive salaries and a generous benefits package, NVIDIA is widely considered to be one of the technology industry's most desirable employers. We have some of the most forward-thinking and versatile people in the world working with us, and our engineering teams are growing fast in some of the most impactful fields of our generation: Physical AI, Smart Spaces, and Vision AI. If you're a creative engineer who enjoys autonomy and shares our passion for technology, we want to hear from you.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 320,000 USD - 488,750 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until July 26, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Distinguished Engineer, Scaled Out Inferencing
Distinguished Engineer, Scaled Out Inferencing

2100 NVIDIA USA • Santa Clara (CA)

On-site
USD 320,000 - 489,000
Distinguished Engineer, Scaled Out Inferencing
Distinguished Engineer, Scaled Out Inferencing

Nvidia Corporation in • Santa Clara (CA)

On-site
USD 320,000 - 489,000
Equity
Benefits package
Senior ML Engineer, Metropolis
Senior ML Engineer, Metropolis

NVIDIA • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior ML Engineer, Metropolis
Senior ML Engineer, Metropolis

NVIDIA Gruppe • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits
Technical Product Marketing Engineer, Metropolis - New College Grad 2026
Technical Product Marketing Engineer, Metropolis - New College Grad 2026

Nvidia Corporation in • Santa Clara (CA)

On-site
USD 92,000 - 184,000
Senior Software Engineer, Metropolis Vision AI
Senior Software Engineer, Metropolis Vision AI

NVIDIA Corporation • Santa Clara (CA), Northern (KY)

Hybrid
USD 224,000 - 357,000
Equity
Benefits
Senior ML Engineer, Metropolis
Senior ML Engineer, Metropolis

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits
Technical Product Marketing Engineer
Technical Product Marketing Engineer

NVIDIA Gruppe • Santa Clara (CA)

On-site
USD 116,000 - 184,000
Equity
Benefits
Distinguished Engineer, Scaled Out Inferencing
Distinguished Engineer, Scaled Out Inferencing

Nvidia Corporation • Santa Clara (CA)

On-site
USD 320,000 - 489,000
Equity
Benefits package
Technical Product Marketing Engineer, Metropolis - New College Grad 2026
Technical Product Marketing Engineer, Metropolis - New College Grad 2026

NVIDIA • Santa Clara (CA)

On-site
USD 92,000 - 184,000