Lead Architect, High-Performance LLM Training

NVIDIA Gruppe; Santa Clara (CA); On-site; USD 272,000 - 431,250; Full time

Job summary

NVIDIA Gruppe is looking for a Principal Engineer to enhance performance in AI training and workloads across its hardware and software stack. This role focuses on performance analysis and optimization for LLM workloads running on NVIDIA’s cutting-edge technology.

The successful candidate will need a strong technical background, with over 12 years of experience in relevant fields and a proven record in AI systems. A diverse work environment and robust benefits package await you.

Qualifications

• 12+ years of relevant work or research experience.
• Deep hands-on experience analyzing and optimizing large-scale deep learning workloads.
• Strong expertise in GPU and AI accelerator architecture.
• Experience with distributed training techniques.

Responsibilities

• Lead performance analysis and optimization of LLM workloads.
• Identify bottlenecks across various system elements for optimization.
• Develop production-quality software and tools to improve performance.
• Mentor engineers and establish best practices in performance analysis.

Skills

Large-scale AI training systems

GPU performance optimization

Distributed systems

High-performance computing

ML frameworks

Technical leadership

Education

MS, PhD, or equivalent experience in Computer Science, Electrical Engineering, or related field

Tools

Profiling tools

Benchmarking tools

Performance modeling tools

Job description

NVIDIA Gruppe is looking for a Principal Engineer to enhance performance in AI training and workloads across its hardware and software stack. This role focuses on performance analysis and optimization for LLM workloads running on NVIDIA’s cutting-edge technology.

The successful candidate will need a strong technical background, with over 12 years of experience in relevant fields and a proven record in AI systems. A diverse work environment and robust benefits package await you.