Senior Solutions Architect, AI Performance Engineering

NVIDIA Corporation

California

On-site

USD 184,000 - 357,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Benefits package

Job summary

NVIDIA Corporation in California seeks a Solutions Architect with a strong performance engineering background to accelerate Physical AI workloads on NVIDIA’s full-stack platforms for Autonomous Vehicles and Robotics.

You will engage with AV application engineers, optimize GPUs, and contribute to libraries such as cuDNN, cuBLAS, and CUTLASS while collaborating with architecture, research, and software teams.

Qualifications

  • 8+ years hands-on ML/DL performance engineering experience.

Responsibilities

  • Engage directly with AV application engineers to understand problems and propose GPU-accelerated solutions.
  • Develop and improve fundamental parallel algorithms and data structures for performance.
  • Provide efficient GPU-based solutions through library development and direct contributions.
  • Collaborate with architecture, research, libraries, tools, and system software teams to influence future NVIDIA platforms and programming models.
  • Perform deep optimization of high-performance operators, including GPU kernel tuning, instruction-level optimization, and compiler optimization.
  • Support customers in using NVIDIA libraries (cuDNN, cuBLAS, CUTLASS) and open-source libs (DeepGEMM, FlashMLA, FlashAttention, Flashinfer).
  • Improve interconnect-based communication for distributed transformer workloads using NCCL, NVSHMEM, and related tools.
  • Study interconnect topologies (NVLINK) and network protocols to optimize data transfer and compute-communication overlap.

Job description

We are looking for a Solutions Architect with a performance engineering background who can help our most sophisticated Autonomous Vehicles and Robotics customers accelerate Physical AI workloads using NVIDIA's full-stack technologies! As part of the Automotive Solutions Architecture team, we work with some of the most innovative accelerated computing platforms focused on the development and test of Autonomous Vehicles. We dive deep into customer projects to solve performance bottlenecks. We use insights from workloads to guide next-generation NVIDIA hardware and software. If you are driven by innovation and ambition, this is the team for you!

What you’ll be doing:

Engaging directly with key AV application engineers to understand the current and future problems they are solving. You will develop and improve fundamental parallel algorithms and data structures. You will provide efficient solutions using GPUs through library development and direct application contributions. Collaborating closely with the architecture, research, libraries, tools, and system software teams at NVIDIA to influence the build of next-generation architectures, software platforms, and programming models. Engaging in deep optimization of high-performance operators, involving but not limited to GPU kernel optimization, instruction-level tuning, and compiler optimization. These optimizations will directly support customers to use NVIDIA libraries such as cuDNN, cuBLAS, and CUTLASS and Open- source libs like DeepGEMM, FlashMLA, FlashAttention, Flashinfer, etc. Improving communication for Physical AI-related distributed transformer workloads by employing communication tools developed by NVIDIA. These include NCCL, NCCL GIN, and NVSHMEM, as well as open-source solutions like DeepEP and NCCL EP. This demands in-depth study of interconnect topologies (NVLINK) and network protocols (InfiniBand/RoCE) to develop efficient data transfer strategies alongside techniques enabling compute-communication overlap.

What we need to see:

BSc/MSc/PhD or equivalent experience in Computer Science, Electrical Engineering, Physics, Mathematics, or a related technical field. 8+ years of hands‑on validated ML/DL performance engineering experience with focus on improving GPU compute efficiency of training and inferencing workloads. Experience with C, C++, or Python and proficiency with Linux. Solid understanding of software development, programming techniques, and algorithms. Strong mathematical fundamentals, including linear algebra and numerical methods. Background in parallel programming and high-performance computing, with extensive knowledge of parallel architectures and methods for performance analysis and tuning. Experience in GPU programming is desirable. Experience in distributed communication optimization is highly helpful. This involves familiarity with remote direct memory access, GPU interconnects, collective communication algorithms, and associated open-source libraries used in large-scale model training and inference. Effective verbal/written communication, and technical presentation skills. Ability to communicate your ideas/code clearly through blog posts, GitHub, ppt.

Ways to stand out from the crowd:

Prior experience in writing CUDA kernels, and experience with Nsight System and Nsight Compute. Experience in comprehensive evaluation and improvement of full-stack systems within at least one of these areas: LLM and HPC. Having expertise ranging from operator‑level through framework‑level to algorithm‑level optimization is strongly preferred. Proven software engineering fundamentals and system architecture thinking, with the ability to build modules and lead engineering approaches in complex systems.

Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/ #NALASAHiring Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5. You will also be eligible for equity and benefits. Applications for this job will be accepted at least until October 31, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Solutions Architect, AI Performance Engineering
Senior Solutions Architect, AI Performance Engineering

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits package
Senior Solutions Architect, AI Performance Engineering
Senior Solutions Architect, AI Performance Engineering

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 287,500
Senior Systems Performance Engineer
Senior Systems Performance Engineer

NVIDIA Corporation • California

On-site
USD 136,000 - 259,000
Equity
Benefits package
Senior AI Training Performance Architect
Senior AI Training Performance Architect

NVIDIA • United States

On-site
USD 184,000 - 357,000
Senior Software Engineer, AI Performance Analysis
Senior Software Engineer, AI Performance Analysis

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 288,000
Equity
Benefits package
Senior Software Engineer - AI Inference Performance
Senior Software Engineer - AI Inference Performance

NVIDIA Corporation • Santa Clara (CA)

Hybrid
USD 184,000 - 357,000
Senior AI Systems Performance Engineer
Senior AI Systems Performance Engineer

NVIDIA Corporation • Texas

On-site
USD 184,000 - 287,500
Equity
Benefits
Senior Software Engineer - AI Inference Performance
Senior Software Engineer - AI Inference Performance

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Senior AI Systems Performance Engineer
Senior AI Systems Performance Engineer

NVIDIA Corporation • California

On-site
USD 184,000 - 287,500
Equity
Comprehensive benefits
Senior Solutions Architect, Generative AI
Senior Solutions Architect, Generative AI

NVIDIA Corporation • Santa Clara (CA)

Remote
USD 184,000 - 357,000