Senior AI Networking and Performance Engineer for LLMs

Nvidia Corporation; Santa Clara (CA); On-site; USD 272,000 - 431,250; Full time

Benefits offered by this job

Equity

Comprehensive benefits

Job summary

Nvidia Corporation is seeking a Senior Software Engineer to optimize AI workloads on large-scale GPU and CPU clusters. In this role, you will analyze and benchmark performance for distributed Deep Learning workloads, focusing on high-performance networking.

The ideal candidate will have a B.Sc in Computer Science, 15+ years’ experience, and proficiency in Python, Bash, and C++. Knowledge of NVIDIA GPUs and deep learning frameworks is essential. The role offers competitive salary and equity.

Qualifications

• 15+ years of experience in high-performance networking.
• Demonstrated ability in performance evaluation.
• Experience with NVIDIA GPUs and networking collective communication libraries.

Responsibilities

• Characterizing AI workloads for NVIDIA supercomputers.
• Benchmarking and profiling performance for optimizations.
• Collaborating across hardware and software for performance insights.

Skills

High-performance networking (RDMA, MPI, NCCL, SHARP)

Performance evaluation techniques

Programming languages (Python, Bash, C++)

Deep learning frameworks (TensorFlow, PyTorch)

Analytical and problem-solving skills

Education

B.Sc in Computer Science or Software Engineering

Tools

CUDA library

Container-based development environment

Job description

Nvidia Corporation is seeking a Senior Software Engineer to optimize AI workloads on large-scale GPU and CPU clusters. In this role, you will analyze and benchmark performance for distributed Deep Learning workloads, focusing on high-performance networking.

The ideal candidate will have a B.Sc in Computer Science, 15+ years’ experience, and proficiency in Python, Bash, and C++. Knowledge of NVIDIA GPUs and deep learning frameworks is essential. The role offers competitive salary and equity.