Performance DL Engineer for LLMs & Transformer Optimizations

NVIDIA; Santa Clara (CA); On-site; USD 124,000 - 242,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking software engineers to build and optimize libraries that accelerate Deep Learning researchers and engineers. Work spans Transformer Engine, DL models, and open-source contributions to PyTorch and JAX.

You will engage with the open-source community and support enterprise customers while influencing hardware and software design for NVIDIA GPUs. The role emphasizes collaboration across teams and strong software craftsmanship, with competitive base salaries and equity.

Qualifications

• BS or equivalent experience in Computer Science, Electrical Engineering, or related field.
• 2+ years of experience in C++ and Python programming.
• Strong background in parallel systems programming, preferably on GPUs.
• Knowledge of Computer Architecture, Code Optimization, and/or Operating Systems.
• Proven experience in developing large software projects.
• Excellent verbal and written communication skills.

Responsibilities

• Build and support Transformer Engine, the open-source library for accelerating the training of Large Language Models.
• Collaborate on systems research to improve Deep Learning model performance.
• Implement, benchmark, and optimize new DL models for NVIDIA GPUs and systems.
• Build and contribute to NVIDIA submissions on community benchmarks like MLPerf.
• Engage with open-source community and support enterprise customers by delivering NVIDIA innovations.
• Influence the design of new hardware generations and core platform software components.

Skills

C++

Python

Parallel systems

Communication

Education

BS in CS or related field

Tools

CUDA

cuDNN

cuBLAS

Job description

NVIDIA is seeking software engineers to build and optimize libraries that accelerate Deep Learning researchers and engineers. Work spans Transformer Engine, DL models, and open-source contributions to PyTorch and JAX.

You will engage with the open-source community and support enterprise customers while influencing hardware and software design for NVIDIA GPUs. The role emphasizes collaboration across teams and strong software craftsmanship, with competitive base salaries and equity.