Senior LLM Training Performance Architect

NVIDIA; Santa Clara (CA); Hybrid; USD 184,000 - 356,500; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking a Senior High-Performance LLM Training Engineer to enhance the efficiency of LLM training workloads. Focused on optimizing NVIDIA's software stack in frameworks such as PyTorch and JAX, this role entails working with advanced GPU technologies.

The ideal candidate should possess a PhD or equivalent degree with substantial experience in deep learning, GPU architecture, and performance optimization. The base salary ranges between 184,000 USD and 356,500 USD based on experience and position level.

Qualifications

• PhD or MS in relevant fields with extensive work experience.
• Strong deep learning and neural network background.
• Experience in performance analysis and tuning applications.

Responsibilities

• Optimize NVIDIA's high-performance LLM software stack.
• Implement software in deep learning platforms like PyTorch and JAX.
• Build tools for workload optimization and analysis.

Skills

Deep learning

Neural networks

Performance analysis

Optimization

GPU architecture

C++

Python

CUDA

Education

PhD in Computer Science, Electrical Engineering or Computer Engineering

MS or equivalent experience

Job description

NVIDIA is seeking a Senior High-Performance LLM Training Engineer to enhance the efficiency of LLM training workloads. Focused on optimizing NVIDIA's software stack in frameworks such as PyTorch and JAX, this role entails working with advanced GPU technologies.

The ideal candidate should possess a PhD or equivalent degree with substantial experience in deep learning, GPU architecture, and performance optimization. The base salary ranges between 184,000 USD and 356,500 USD based on experience and position level.