Senior DL Systems Engineer, LLM & GPU Performance

NVIDIA Gruppe

Santa Clara (CA)

On-site

USD 272,000 - 431,250

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Equity
Benefits

Job summary

NVIDIA is seeking a senior AI systems architect to advance agentic LLM workloads with scalable, datacenter-level design and performance tuning.

You will drive research integration, optimize latency and throughput, and collaborate across internal teams and external partners to define workload requirements. Expertise in deep learning systems, Python, C++, and GPU architectures is essential.

Qualifications

  • BS, MS or PhD in Computer Science, Electrical Engineering, Computer Engineering, or a related field (or equivalent).
  • 15+ years of experience in deep learning and deep learning systems design.
  • Proficiency in Python and C++ programming.
  • Strong understanding of computer architecture, and GPU/parallel datacenter computing fundamentals.

Responsibilities

  • Research and Development: Explore and incorporate contemporary research on generative AI, agents, and inference systems into the NVIDIA LLM software stack.
  • Workload Analysis and Optimization: Profile and optimize agentic LLM workloads to reduce latency and increase throughput while maintaining fidelity.
  • System Design and Implementation: Design and implement scalable systems to accelerate agentic workloads for datacenter-scale use cases.
  • Collaboration and Communication: Advise on software/hardware/system iterations by engaging with NVIDIA teams and external partners and formalizing workload requirements.

Skills

Python
C++
Deep learning
Performance modeling

Education

BS/MS/PhD in CS/EE/CE or related field

Tools

CUDA
OpenCL

Job description

NVIDIA is seeking a senior AI systems architect to advance agentic LLM workloads with scalable, datacenter-level design and performance tuning.

You will drive research integration, optimize latency and throughput, and collaborate across internal teams and external partners to define workload requirements. Expertise in deep learning systems, Python, C++, and GPU architectures is essential.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Lead Architect, High-Performance LLM Training
Lead Architect, High-Performance LLM Training

NVIDIA Gruppe • Santa Clara (CA)

On-site
USD 272,000 - 432,000
Senior DL Performance Architect, AI Hardware & Optimization
Senior DL Performance Architect, AI Hardware & Optimization

NVIDIA • Santa Clara (CA)

On-site
USD 184,000 - 287,500
Equity benefits
Comprehensive health benefits
Senior DL Inference Engineer — GPU-Optimized LLMs (Remote)
Senior DL Inference Engineer — GPU-Optimized LLMs (Remote)

NVIDIA Corporation • Northern (KY)

Hybrid
USD 152,000 - 288,000
Senior AI Systems Performance Engineer (LLM & GPU)
Senior AI Systems Performance Engineer (LLM & GPU)

Conductor • San Jose (CA)

On-site
USD 138,000 - 206,000
Competitive pay range
4+ weeks of PTO
On-demand mental health apps
+1
Senior AI Inference Engineer — GPU-Accelerated DL Systems
Senior AI Inference Engineer — GPU-Accelerated DL Systems

NVIDIA Corporation • California (MO)

On-site
USD 152,000 - 287,500
Equity
Benefits
Senior DL Performance Engineer - LLM/Transformer Optimizations
Senior DL Performance Engineer - LLM/Transformer Optimizations

NVIDIA AI • Santa Clara (CA)

On-site
USD 152,000 - 288,000
Equity
Benefits
Senior Deep Learning Performance Architect - LPU
Senior Deep Learning Performance Architect - LPU

NVIDIA Gruppe • California (MO)

On-site
USD 152,000 - 241,500
Senior DL Hardware Modeling Architect — Equity Options
Senior DL Hardware Modeling Architect — Equity Options

NVIDIA • Massachusetts

On-site
USD 152,000 - 288,000
Senior DL Inference Architect (Hybrid)
Senior DL Inference Architect (Hybrid)

NVIDIA Gruppe • Santa Clara (CA)

Hybrid
USD 184,000 - 288,000
Senior LLM Inference Architect
Senior LLM Inference Architect

NVIDIA • Santa Clara (CA)

On-site
USD 272,000 - 432,000
Equity
Benefits