Senior Systems Software Engineer, Workload Systems Engineering

NVIDIA Corporation; Santa Clara (CA); Hybrid; USD 184,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA Corporation in Santa Clara, CA seeks a senior systems software engineer to optimize large-scale build, simulation and validation workloads across GPU and CPU resources. You will enable remote execution, self-service workflows, and end-to-end diagnostics for engineering teams.

Responsibilities include diagnosing performance bottlenecks, improving scheduling, resource sharing, and implementing infrastructure-level changes with cross-functional teams to deliver measurable gains in

Qualifications

• 8+ years of software engineering experience in production compute infrastructure or large-scale systems.
• Hands-on debugging of complex performance or reliability issues using logs, metrics, traces, profiling and experiments.
• Proficiency in a systems programming or automation language and delivering tested changes into production infrastructure.
• Deep Linux experience and exposure to GPU systems, scheduling/resource management, remote execution, storage, or host/container infra.
• Ability to collaborate across teams, turn ambiguous symptoms into clear plans, and explain results to engineers.

Responsibilities

• Build self-service and validation mechanisms for configuring infrastructure workflows.
• Provide diagnostic views across application, submission, remote execution, and host layers to identify failures.
• Set and measure performance/reliability benchmarks using profiling, traces, and experiments.
• Improve compute/GPU selection, scheduling, placement, concurrency, and input/output paths.
• Make retry causes and recovery outcomes visible; collaborate with owners to reduce failures.
• Implement infra-level changes with application/build/CI, remote-execution, and infra teams; measure impact on turnaround and capacity.
• Document and hand off successful investigations into workflows and diagnostics.

Skills

Distributed systems

Linux proficiency

Performance profiling

Systems programming

Education

CS/CE degree or equivalent

Tools

Bazel

CUDA

Job description

NVIDIA is seeking a senior systems software engineer to help engineering teams run demanding build, simulation, and validation workloads efficiently and reliably. Our Workload Systems Engineering team connects customer workflows with the infrastructure that performs them. We develop self-service mechanisms and clear diagnostics, investigate performance and reliability across system boundaries, and deliver measured infrastructure improvements with the teams that own the underlying components.

Your responsibilities include enabling application configuration, remote execution, workers, hosts, GPU and CPU resources, storage, data paths, and on-target systems. The position requires direct system evaluation: diagnosing causes of slow or failing workloads, trying alternatives in representative scenarios, applying improvements with others, and verifying customer advantages.

What you'll be doing:

• Build shared self-service and validation mechanisms that let engineering teams configure and use supported infrastructure workflows with less manual assistance.
• Give customers and on-call teams useful diagnostic views across application, submission, remote-execution, and host or target layers so they can identify where failures and slowdowns originate.
• Set performance and reliability benchmarks for representative workloads. Apply profiling, metrics, traces, and controlled experiments to pinpoint the changes that make a difference.
• Evaluate and improve compute and GPU selection, scheduling and placement, concurrency, worker and runner configuration, resource sharing, caching, and input/output paths.
• Make retry causes, recovery outcomes, and wasted execution capacity visible. Work with component owners to eliminate recurring failures and unnecessary re-execution.
• Implement and validate infrastructure-level changes with application, build and CI, remote-execution, and infrastructure teams. Measure the effect on turnaround, successful efficiency, stability, usable capacity, and cost.
• Turn successful investigations into supported workflows, diagnostics, documentation, and clear customer handoffs.

What we need to see:

• Over 8 years of solid software engineering experience working with production compute infrastructure, distributed systems, large-scale build and test systems, or comparable systems software.
• Hands-on experience debugging complex performance or reliability issues across software and hardware boundaries using logs, metrics, traces, profiling, and experiments.
• Proficiency in a systems programming or automation language and experience delivering tested changes into production infrastructure.
• In-depth experience with Linux and proficiency in one or more of these fields: GPU systems and drivers, scheduling and resource management, remote execution or CI infrastructure, storage and data paths, or host and container infrastructure.
• Ability to work across teams with different component ownership, turn ambiguous symptoms into a clear technical plan, and explain results to engineering customers.
• A degree in computer science, computer engineering, or a related field, or equivalent experience.

Ways to stand out from the crowd:

• Experience with GPU sharing and isolation, CUDA execution behavior, MIG or MPS or equivalent experience, GPU driver diagnostics, or high-performance computing workloads.
• Experience with workload placement, CPU and GPU concurrency, NUMA, cloud-instance benchmarking, or cost and performance tradeoffs.
• Familiarity with Bazel, remote execution, build front ends, simulation or replay workloads, and hardware-in-the-loop validation.
• Experience improving file-system, caching, networking, or high-throughput data paths under concurrent workloads.
• A record of building customer self-service or observability tools and using incident and retry data to drive verified reliability improvements.

Widely considered to be one of the technology world's most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/

#LI-Hybrid

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until October 23, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.