Senior Software Workload Optimization Engineer

NVIDIA Corporation

United States

Hybrid

USD 150,000 - 351,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Benefits

Job summary

NVIDIA Corporation is hiring a senior performance engineer to investigate and optimize AI workloads across GPU systems. You will identify bottlenecks in compute, memory, and data movement, improve parallelism strategies, and validate changes to reduce GPU hours per unit of useful work while increasing throughput.

You will design clear benchmarks, work with workload owners to test improvements, and drive optimization projects from investigation through measurable results in a collaborative,

Qualifications

  • Bachelor’s degree or equivalent experience and 5+ years of relevant experience.
  • Ability to reason about and optimize parallelism strategies to balance throughput and GPU resource use.
  • Experience with profiling, benchmarking and measurements to guide optimization decisions.
  • Familiarity with GPU architecture factors affecting utilization and performance.

Responsibilities

  • Investigate performance of evaluation and AI workloads across GPU systems.
  • Identify bottlenecks in compute, memory, communication, and data movement.
  • Improve parallelism configurations and workload distribution across GPUs and nodes.
  • Design benchmarks and measurements considering throughput, latency, and resource use.
  • Partner with workload owners to test improvements and deploy solutions.
  • Independently prioritize and drive optimization projects from investigation through measurable results.

Skills

Parallelism optimization
Profiling & benchmarking
GPU architectures
Tensor cores familiarity

Education

Bachelor’s degree or equivalent experience

Tools

Profiling tools

Job description

What you’ll be doing:

Investigate the performance of evaluation and other AI workloads across GPU systems. Identify bottlenecks in computation, memory, communication, data movement, orchestration, and resource allocation. Evaluate and improve parallelism configurations, including how work is distributed across GPUs and nodes. Understand how effectively workloads use GPU capabilities, including tensor cores, and identify opportunities to improve utilization. Implement and validate changes that reduce GPU hours per unit of useful work or increase throughput. Design clear benchmarks and measurements, accounting for tradeoffs among throughput, latency, resource use, and the quality or correctness of results. Partner with workload owners to understand requirements, test improvements, and help deploy solutions. Independently prioritize and drive optimization projects from investigation through measurable results.

What we need to see:

Experience analyzing and improving the performance of compute-intensive software Bachelor’s degree or equivalent experience, and 5+ years of relevant experience Ability to reason about and optimize parallelism strategies – including tensor, data, pipeline, context, and expert parallelism – to balance throughput, communication overhead, and GPU resource use. Investigate unfamiliar code/systems and work directly with code owners to land end‑to‑end optimizations. Understanding of GPU architecture and the factors that affect utilization and application performance. Experience using profiling, benchmarking, and measurement to guide optimization decisions. Ability to work independently, communicate findings clearly, and collaborate with researchers and engineers. Three or more years of relevant experience.

Ways to stand out from the crowd.

Optimizing AI training, inference, evaluation, or other large‑scale GPU workloads. Working with GPU programming or machine learning frameworks and performance tools. Improving workload scheduling, batching, data pipelines, or multi‑GPU configurations. Familiarity with collection and interpretation of GPU telemetry Energy‑proportional computing or performance optimization under power, energy, or thermal design power budgets and experience with model quantization or numerical methods.

Salary and benefits

Your base salary will be determined based on your location, experience, and other objective job‑related factors. The expected base salary ranges for this position are: 150,000 USD – 286,000 USD for Level3; and 183,750 USD – 351,000 USD for Level4. You will also be eligible for equity and benefits. Applications for this job will be accepted at least until November20,2026. #LI‑Hybrid

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Workload Optimization Engineer
Senior Software Workload Optimization Engineer

NVIDIA Corporation • Seattle (WA)

Hybrid
USD 150,000 - 351,000
Equity compensation
Benefits package
Inference Performance Engineer, Agent Driven Inference Optimization
Inference Performance Engineer, Agent Driven Inference Optimization

2100 NVIDIA USA • Santa Clara (CA)

Hybrid
USD 124,000 - 242,000
Inference Performance Engineer, Agent Driven Inference Optimization
Inference Performance Engineer, Agent Driven Inference Optimization

NVIDIA Corporation • Santa Clara (CA)

Hybrid
USD 124,000 - 242,000
Equity
Health benefits
Hybrid work model
Senior AI and Quant DevTech Engineer
Senior AI and Quant DevTech Engineer

NVIDIA Corporation • Santa Clara (CA)

Hybrid
USD 184,000 - 288,000
Equity
Benefits
Senior AI and FSI Developer Technology Engineer
Senior AI and FSI Developer Technology Engineer

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 152,000 - 242,000
Equity
Benefits
Hybrid work
Senior Software Engineer, AI Performance Analysis
Senior Software Engineer, AI Performance Analysis

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 288,000
Equity
Benefits package
Senior Systems Software Engineer - GPU Performance at Scale
Senior Systems Software Engineer - GPU Performance at Scale

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 356,500
Senior AI Training Performance Architect
Senior AI Training Performance Architect

NVIDIA • United States

On-site
USD 184,000 - 357,000
Senior AI Systems Performance Engineer
Senior AI Systems Performance Engineer

NVIDIA Corporation • California

On-site
USD 184,000 - 287,500
Equity
Comprehensive benefits
Senior Solutions Architect, AI Performance Engineering
Senior Solutions Architect, AI Performance Engineering

NVIDIA Corporation • California

On-site
USD 184,000 - 357,000
Equity
Benefits package