Edge DL Systems Engineer - Real-Time AI Inference

NVIDIA Corporation; Santa Clara (CA); On-site; USD 224,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA Corporation is seeking a Senior Systems Software Engineer to optimize deep learning inference for autonomous vehicles and robotics on edge devices. You will analyze models at the operator level, diagnose performance issues, and drive improvements across TensorRT, Torch-TRT, and MLIR toolchains on Jetson, DRIVE, and ARM platforms.

The role demands 12+ years in industry with 8+ years in DL optimization, CUDA expertise, and embedded software experience in latency-sensitive environments.

Qualifications

• Master's degree or equivalent experience in Computer Science, Electrical Engineering, or a related field.
• Over 12 years working in the industry, including at least 8 years specializing in deep learning model optimization, inference engineering, or neural network compilation.
• Proficiency in understanding and reviewing model architectures at the operator/kernel level.

Responsibilities

• Address customer and partner optimization challenges: analyze, debug, and improve deep learning models on NVIDIA platforms for automotive OEMs and robotics partners.
• Own performance benchmarking: lead MLPerf Edge and industry benchmarks; define methodology, ensure reproducibility, turn results into optimization priorities.
• Evaluate emerging model architectures: investigate DL architectures for compilation feasibility, memory footprint, and latency on target SOCs.
• Collaborate across teams: work with compiler, runtime, and hardware groups to tie model insights to platform capabilities.
• Represent NVIDIA externally: share optimization expertise at conferences and partner events; bring back insights to the team.
• Deliver TensorRT and compiler-stack solutions for edge: build and deploy inference on Jetson, DRIVE, and GPU + ARM platforms.

Skills

CUDA

C/C++

TensorRT

MLIR

Embedded

GPU Architecture

Python

Education

Master's degree or equivalent in Computer Science, Electrical Engineering, or related field

Tools

TensorRT

Torch-TRT

MLIR

Job description

NVIDIA Corporation is seeking a Senior Systems Software Engineer to optimize deep learning inference for autonomous vehicles and robotics on edge devices. You will analyze models at the operator level, diagnose performance issues, and drive improvements across TensorRT, Torch-TRT, and MLIR toolchains on Jetson, DRIVE, and ARM platforms.

The role demands 12+ years in industry with 8+ years in DL optimization, CUDA expertise, and embedded software experience in latency-sensitive environments.