GenAI Algorithms – Model Optimization for Inference

NVIDIA Corporation; United States; Remote; USD 30,000 - 53,000; Full time

Benefits offered by this job

Competitive salary

Comprehensive benefits package

Job summary

NVIDIA Corporation ищет стажера по моделям генеративного ИИ для оптимизации алгоритмов инференса и развертывания на аппаратуре NVIDIA. Работайте над балансом точности и скорости, используя современные методики и инструменты.

Вы будете взаимодействовать с командой Model Optimizer, NeMo/Megatron, TensorRT-LLM и открытыми фреймворками, включая PyTorch и vLLM, с акцентом на удобство использования и эффективность.

Qualifications

• П pursuing a Master’s or PhD in CS/AI or related field.
• Сильный опыт глубокого обучения и работы с языковыми моделями.
• Устойчивое знание алгоритмов и программирования.
• Уверенное владение Python и PyTorch.
• Хорошие письменные и устные коммуникационные навыки.

Responsibilities

• Проектирование и построение модульных, масштабируемых платформ оптимизации моделей.
• Интеграция новых алгоритмов оптимизации (квантование, distillation, pruning, NAS) в стек NVIDIA.
• Развертывание оптимизированных моделей в фреймворках инференса и создание API.
• Сотрудничество с командами NVIDIA по решениям для клиентов и пайплайнам.
• Проведение профилирования на уровне GPU и поиск точек оптимизации.

Skills

Master's or PhD in CS/AI

Deep learning

Language models

Python

PyTorch

Communication skills

Education

Master's or PhD in CS/AI or related field

Tools

JAX

vLLM

SGLang

Job description

Описание

NVIDIA is at the forefront of the generative AI revolution! The Algorithmic Model Optimization Team focuses on optimizing generative AI models such as large language models (LLMs), vision-language models (VLMs), and diffusion models for maximal inference efficiency using techniques ranging from quantization, speculative decoding, sparsity, distillation, pruning to neural architecture search, and automated deployment strategies. Our work includes conducting applied research to improve model efficiency as well as developing an innovative open-source model optimization platform (NVIDIA Model Optimizer). Our software is used both internally across NVIDIA and externally by research and engineering teams alike developing best-in-class AI models.

We are seeking a GenAI Algorithms Intern to help optimize state-of-the-art generative AI models like LLMs, VLMs, multimodal and diffusion models. In this role, you will design, implement, and productionize model optimization algorithms for inference and deployment on NVIDIA's latest hardware platforms. The focus is on ease of use, compute and memory efficiency, and achieving the best accuracy-performance tradeoffs through software-hardware co-design.

Your work will span multiple layers of the AI software stack - ranging from algorithm design to integration - within NVIDIA's ecosystem (Model Optimizer, NeMo/Megatron, TensorRT-LLM) and open-source frameworks (PyTorch, Hugging Face, vLLM, SGLang). You may also dive deeper into GPU-level optimization, including custom kernel development with CUDA and Triton.

Задачи

Help design and build modular, scalable model optimization software platforms that deliver exceptional user experiences while supporting diverse AI models and optimization techniques.

Explore, develop, and integrate innovative deep learning optimization algorithms (quantization, speculative decoding, sparsity, distillation, pruning, neural architecture search) into NVIDIA's AI software stack.

Deploy optimized models into leading open-source inference frameworks and contribute specialized APIs, model-level optimizations, and new features tailored to the latest NVIDIA hardware capabilities.

Collaborate with NVIDIA teams on model optimization solutions for customer use cases, aiming for optimal end-to-end workflows and balanced accuracy-performance trade-offs.

Conduct GPU kernel-level profiling to identify and capitalize on hardware and software optimization opportunities (e.g., efficient attention kernels, KV cache optimization, parallelism strategies).

What we need to see:

• Pursuing a Master's or PhD in Computer Science, AI, Applied Math, or a related field.
• Strong deep learning background and hands-on experience with language models.
• Solid foundation in algorithms and programming.
• Proficiency in Python, PyTorch, and modern ML frameworks/tools.
• Good written and verbal communication skills, with the ability to work both independently and collaboratively in a fast-paced environment.

Benefits

• Increasingly known as "the AI computing company" and widely considered to be one of the technology world's most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package.

Requirements

• Experience with model optimization and efficiency (e.g. quantization, distillation, pruning).
• Contributions to PyTorch, JAX, vLLM, SGLang, or other machine learning training and inference frameworks.
• Hands-on experience training or fine-tuning generative AI models on large-scale GPU clusters.
• Knowledge of GPU architectures and compilation stacks, and the ability to analyze and debug end-to-end performance.
• Familiarity with NVIDIA's deep learning SDKs (Model Optimizer, NeMo).

EEO/DEI

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer.

As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Internship Pay

For Poland: the annual range for our interns is 117,750 PLN - 204,100 PLN. (pro-rated for the duration of the internship).