Senior System Software Engineer - AI Performance and Efficiency Tools

NVIDIA; United States; On-site; USD 184,000 - 287,500; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is looking for a skilled software engineer to develop internal profiling and debugging tools for AI workloads in a GPU cluster. The ideal candidate will have over 6 years of experience, with strong skills in C++ and Python, and a solid understanding of deep learning frameworks like PyTorch and TensorFlow.

The position is based in the United States, with a competitive salary range of $184,000 to $287,500, depending on experience and level. NVIDIA is committed to diversity and equal opportunity in its hiring practices.

Qualifications

• 6+ years of software development experience.
• Strong design and coding skills in C++ and Python.
• Good understanding of AI systems and GPU architecture.

Responsibilities

• Build internal profiling and analysis tools for AI workloads.
• Create debugging tools for memory and networking issues.
• Develop benchmarking technologies for AI systems.

Skills

C++

Python

Deep Learning frameworks (PyTorch, TensorFlow)

GPU cluster job scheduling (Slurm or Kubernetes)

NVIDIA GPUs

CUDA Programming

Analytical skills

Debugging

Education

BS in Computer Science or related field

Job description

A key part of NVIDIA's strength is our sophisticated analysis and debugging tools that empower NVIDIA engineers to improve performance and power efficiency of our products and the running applications. We are looking for forward-thinking, hard-working, and creative people to join a multifaceted software team with high standards. This software engineering role involves developing tools for AI researchers and SW/HW teams running AI workload in a GPU cluster.

As a member of the software development team, you will work with users from different departments such as Architecture teams and Software teams. Your work will bring users intuitive, rich, and accurate insight into the workload and the system, empowering them to find opportunities in software and hardware, build high-level models to propose and deliver the best hardware and software to our customers, or debug tricky failures and issues to improve performance and efficiency.

What you’ll be doing:

• Build internal profiling and analysis tools for AI workloads at large scale
• Build debugging tools for common encountered problems such as memory or networking
• Create benchmarking and simulation technologies for AI systems or GPU clusters
• Partner with HW architects to propose new features or improve existing features with real-world use cases

What we need to see:

• BS+ in Computer Science or related (or equivalent experience) and 6+ years of software development
• Strong software skills in design, coding (C++ and Python), analytical, and debugging
• Good understanding of Deep Learning frameworks like PyTorch and TensorFlow, distributed training and inference
• Knowledge of GPU cluster job scheduling (Slurm or Kubernetes), storage and networking
• Experience with NVIDIA GPUs, CUDA Programming and NCCL
• Motivated self-starter with strong problem-solving skills and customer-facing communication skills
• Passion for continuous learning and ability to work concurrently with multiple global groups

Ways to stand out from the crowd:

• Proven experience in GPU cluster scale continuous profiling & analysis tools/platforms
• Solid experience in large AI job performance analysis for training/inference workload
• Knowledge of Linux device drivers and/or compiler implementation
• Knowledge of GPU and/or CPU architecture and general computer architecture principles

Base salary will be determined based on location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD – 287,500 USD for Level 4, and 224,000 USD – 356,500 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted until May 10, 2026.

Applications for this posting are open.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering a diverse work environment and is an equal opportunity employer. We do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.