Senior Software Engineer, AI Performance Analysis

Socket.dev; Santa Clara (CA); On-site; USD 168,000 - 270,250; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking a senior software engineer to automate and optimize performance analysis workflows for AI training and inference. You will design and build tools that enhance efficiency across engineering teams. Ideal candidates will possess an M.S. or PhD in a relevant field and have over 6 years of experience, particularly with AI workloads.

A competitive salary between $168,000 and $270,250 is offered depending on experience.

Qualifications

• 6+ years of relevant work experience.
• Deep knowledge of AI workloads and their performance characteristics.
• Experience in building tools used by engineers.

Responsibilities

• Design and build performance analysis tools for AI workloads.
• Translate performance engineer needs into scalable tooling.
• Collaborate with teams to align profiling capabilities with AI workloads.
• Identify performance bottlenecks and develop automated detection methods.

Skills

Python

C++

AI workload optimization

Developing performance analysis tools

Interpersonal communication

Education

M.S. or PhD in Computer Science or related field

Job description

NVIDIA GPU Architecture Group is seeking a senior software engineer to automate and optimize performance analysis workflows for AI training and inference workloads. You will not only perform analysis but also reshape how it's done, building tools and workflows that scale across a broad audience of engineers. NVIDIA is a world-class leader in AI workload optimization, and your work will push these boundaries even further!

What you’ll be doing:

• Design and build performance analysis tools and workflows for AI training and inference workloads.

• Understand how AI performance engineers work and translate their needs into scalable, intuitive tooling.

• Develop integrations between profiling infrastructure and AI frameworks and workflows.

• Collaborate with performance engineers, hardware architects, and software teams to ensure profiling capabilities align with real-world AI workloads.

• Identify performance bottlenecks in AI workloads and develop automated approaches to detect and diagnose them.

What we need to see:

• M.S., or PhD in Computer Science, Computer Engineering, or a related field (or equivalent experience). 6+ years of relevant work experience

• Deep knowledge of AI workloads, frameworks, and performance characteristics.

• Experience building tools, workflows, or infrastructure used by other engineers.

• Strong software development skills (Python, C++ preferred).

• Ability to translate user requirements into scalable tooling solutions.

• Up to date with AI-enabled tooling for software development and performance analysis.

• Strong interpersonal skills for understanding engineer difficulties and working across multi-functional teams.

Ways to stand out from the crowd:

• Experience profiling or optimizing AI training or inference pipelines at scale

• Background building developer tools or platforms for ML engineers

• Contributions to open-source AI tooling or frameworks

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 168,000 USD - 270,250 USD for Level 4, and 200,000 USD - 322,000 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until May 19, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.