Principal Software Engineer, Profiling Services

NVIDIA; Austin (TX); On-site; USD 224,000 - 356,500; Full time

Job summary

A leading technology company in Austin is seeking a Senior Software Engineer for their Developer Tools AON team. The successful candidate will architect scalable systems for GPU performance analysis, lead development efforts, and mentor junior engineers. Candidates should have at least 8 years of software development experience in C, C++, and Python, and possess strong communication skills. The role offers a competitive salary and the opportunity to work on cutting-edge machine learning technologies.

Qualifications

• 8+ years of software development experience in C, C++, and Python.
• 12+ years in system software design and performance analysis.
• Expertise in profiling technologies and overhead analysis.

Responsibilities

• Architect and build scalable systems for GPU performance analysis.
• Lead, mentor, and provide code reviews across the AON project.
• Collaborate effectively with teams in the profiling and ML ecosystem.

Skills

Software development in C

Software development in C++

Software development in Python

Interpersonal communication

Profiling technologies

CUDA API knowledge

ML frameworks (PyTorch, JAX)

API design

System security principles

Education

BS or MS degree in Computer Engineering or Computer Science

Job description

Senior Software Engineer, Profiling Services

Join NVIDIA as a Senior Software Engineer on the Developer Tools Always-On Profiling (AON) team, where you'll be instrumental in designing, implementing, and leading our GPU performance analysis service for Machine Learning workloads.

What You’ll Be Doing

• Architect and build scalable systems for the AON profiling service’s core components, mastering inter-process communication, memory management, and low-overhead architectures.
• Promote high standards in software development, including design patterns, concurrency, parallelism, and advanced debugging for asynchronous systems.
• Lead, mentor, and provide code reviews, shaping technical roadmaps and solving complex issues across the AON project.
• Translate user needs into requirements, design documents, and end‑to‑end feature development across applications, drivers, and hardware abstraction layers.
• Collaborate effectively with internal and external teams, communicating and coordinating across the broader profiling and ML ecosystem.

What We Need To See

• BS or MS degree or equivalent experience in Computer Engineering, Computer Science, or a related field.
• 8+ years of software development in C, C++, and Python.
• 12+ years in system software design, operating systems fundamentals, computer architectures, and performance analysis.
• Strong interpersonal, verbal, and written communication skills.
• Expertise in profiling technologies (sampling, tracing), overhead analysis, and diverse profiling data.
• In-depth CUDA API, runtime, and GPU architecture knowledge.
• Familiarity with ML frameworks such as PyTorch and JAX and performance analysis for AI training/inference.
• Experience developing and debugging complex multi‑layered systems, including drivers.
• Proficiency designing APIs and interfaces for profiling tools.
• History of simplifying ill‑defined problems and leading teams to implement solutions.

Ways To Stand Out From The Crowd

• Pioneering low‑overhead profiling systems in complex distributed environments.
• Deep understanding of PyTorch internals and CUDA usage.
• Proficiency in analyzing profiling data and translating insights.
• Skill in translating customer needs into actionable use cases.
• Strong understanding of system security principles.

If this piques your interest and curiosity and sounds like the right role for your next career step, we want to hear from you!

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is $224,000 – $356,500 for Level 5, and $272,000 – $425,500 for Level 6. You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until December 15, 2025.

NVIDIA is committed to fostering a diverse work environment and is proud to be an equal‑opportunity employer. As we highly value diversity, we do not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.