Senior High-Performance LLM Training Engineer (Hybrid, Equity)

NVIDIA Corporation; Santa Clara (CA); Híbrido; USD 184 000 - 357 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Equity

Benefits package

Hybrid work option

Resumo da oferta

NVIDIA Corporation is seeking a Senior High-Performance LLM Training Engineer to optimize large-scale training workloads across GPUs and software stacks. You will profile, tune, and implement production-grade improvements in PyTorch/JAX environments, driving performance across thousands of GPUs and contributing to future hardware studies.

Requires a PhD or MS with extensive experience in deep learning, GPU architectures, and performance modelling, plus proficiency in C++, Python, and CUDA.

Qualificações

• PhD in Computer Science, Electrical Engineering or Computer Engineering with 5+ years; or MS and 8+ years of meaningful work experience.
• Strong background in deep learning and neural networks, especially in training.
• Deep background in computer architecture and GPU architecture fundamentals.
• Proven experience analyzing and tuning application performance & processor and system-level performance modelling.
• Programming skills in C++, Python, and CUDA.

Responsabilidades

• Understand, analyze, profile, and optimize AI training workloads on innovative hardware and software platforms.
• Understand the big picture of training performance on GPUs, prioritizing and solving problems across state-of-the-art neural networks.
• Implement production-quality software in multiple layers of NVIDIA's deep learning platform stack, from drivers to DL frameworks.
• Build and support NVIDIA submissions to the MLPerf Training benchmark suite.
• Implement key DL training workloads in NVIDIA's proprietary processor and system simulators to enable future architecture studies.
• Build tools to automate workload analysis, workload optimization, and other critical workflows.

Conhecimentos

Deep learning & neural networks

GPU architecture familiarity

Performance optimization & profiling

C++

Python

CUDA

Formação académica

PhD in Computer Science / Electrical Engineering / Computer Engineering

Ferramentas

PyTorch

JAX

MLPerf Training Benchmark

Descrição da oferta de emprego

NVIDIA Corporation is seeking a Senior High-Performance LLM Training Engineer to optimize large-scale training workloads across GPUs and software stacks. You will profile, tune, and implement production-grade improvements in PyTorch/JAX environments, driving performance across thousands of GPUs and contributing to future hardware studies.

Requires a PhD or MS with extensive experience in deep learning, GPU architectures, and performance modelling, plus proficiency in C++, Python, and CUDA.