Senior Systems Software Engineer - GPU Performance at Scale

Nvidia

United States

Remote

USD 184,000 - 357,000

Full time

8 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Benefits

Job summary

NVIDIA is seeking a dedicated Senior Systems Software Engineer focused on GPU Performance at Scale. You will lead performance practices across large-scale GPU infrastructure and collaborate with researchers and customers to optimize AI workloads and datacenter platforms.

The role requires deep expertise in CUDA, Slurm, C/C++, Python, Bash, and Linux, with Docker experience. BS/MS/PhD with 8+ years in HPC or DL environments is preferred. Equity and benefits are offered.

Qualifications

  • Proven experience with accelerated computing software stacks (CUDA).
  • Experience with modern cloud and container-based enterprise computing architectures; Slurm preferred.
  • Strong programming/scripting in C/C++/Python/Bash.
  • Deep systems architecture knowledge and performance impact analysis.
  • Experience with container tech and Linux OSes (Docker preferred).
  • Experience in HPC or DL in engineering or academia.
  • Excellent teamwork and communication with results-driven analytic skills.
  • BS in Engineering/Math/Physics/CS; MS/PhD desirable with 8+ years of related work.

Responsibilities

  • Lead performance practices for large-scale GPU infrastructure and datacenter products.
  • Align AI workloads with next-generation datacenter builds for NVIDIA GPUs and networking hardware.
  • Develop solutions that provide continuous insights into AI workload performance.
  • Decompose complex performance issues into minimal reproduction cases to find root causes.
  • Collaborate with SW and FW teams to debug and resolve high-impact firmware/software issues.

Skills

CUDA
Slurm
C/C++/Python/Bash
Linux
HPC environments
Teamwork & communication
Linux-based OSes

Education

BS in Engineering, Mathematics, Physics, or Computer Science
MS or PhD desirable

Tools

Docker

Job description

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.

We are looking for a dedicated engineer for the Senior Systems Software Engineer role, focusing on GPU Performance at Scale. At NVIDIA, this role is uniquely positioned to drive innovation in AI and GPU computing. You will contribute to world-class computing hardware and software, fueling groundbreaking advancements in artificial intelligence. You will provide insights on large-scale system composition and tuning mechanisms for high-performance compute runs. Collaborate with researchers, developers, and customers to craft improved workflows and develop new, leading solutions. Engage with HPC, OS, CPU, GPU compute, and systems specialists to architect, build, and optimize large-scale performance platforms.

What you'll be doing:
  • Lead the implementation of performance practices in large-scale GPU infrastructure, delivering powerful tools, methodologies, and flows to validate and improve multiple datacenter products concurrently.
  • Align next-generation AI workloads with next-generation datacenter builds for NVIDIA GPUs, CPUs, and networking hardware. Engage early with HW/FW/SW/platform internal and customer teams.
  • Develop engineering solutions that provide continuous insights into the performance of AI workloads in evolving environments, generating swift insights into improvements and regressions.
  • Decompose high-complexity performance or stability issues into minimal reproduction cases, working towards identifying the root cause.
  • Participate in collaborations with various SW and FW teams (BMC/SBIOS/OS/drivers, etc.) to develop outstanding methods and tools. Analyze, debug, and resolve critical firmware and software issues to achieve the highest AI workload performance at scale.
What we need to see:
  • Proven understanding of accelerated computing software stacks (CUDA).
  • Experience with modern cloud and container-based enterprise computing architectures, with Slurm preferred.
  • Strong programming and scripting experience in C/C++/Python/Bash.
  • Deep expertise in systems architecture and the impact of various components on performance.
  • Experience with container technology and Linux-based OSes, with Docker preferred.
  • Experience supporting high-performance computing or deep learning in engineering or academic research communities.
  • Strong teamwork and communication skills, coupled with results-focused analytical abilities.
  • BS in Engineering, Mathematics, Physics, or Computer Science (or equivalent experience); MS or PhD desirable with 8+ years of applicable experience.
Ways to Stand Out From the Crowd
  • End-to-end GPU performance engineering from the profiler to systems analysis.
  • Linux systems programming and optimization experience.
  • Exposure to virtualization techniques and cloud platform solutions.
  • Experience with scheduling and resource management systems.
  • Experience with large-scale HPC environments.

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:
184,000 USD – 287,500 USD for Level 4; and 224,000 USD – 356,500 USD for Level 5.
You will also be eligible for equity and benefits .

This posting is for an existing vacancy.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Systems Performance Engineer
Senior AI Systems Performance Engineer

NVIDIA Corporation • California

On-site
USD 184,000 - 287,500
Equity
Comprehensive benefits
Senior AI Systems Performance Engineer
Senior AI Systems Performance Engineer

NVIDIA Corporation • Texas

On-site
USD 184,000 - 287,500
Equity
Benefits
Senior Systems Software Engineer - GPU Performance at Scale
Senior Systems Software Engineer - GPU Performance at Scale

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 356,500
Senior Systems Software Engineer - GPU Performance at Scale
Senior Systems Software Engineer - GPU Performance at Scale

NVIDIA Corporation • Texas

On-site
USD 184,000 - 287,500
Equity
Benefits
Senior Systems Software Engineer - GPU Performance at Scale
Senior Systems Software Engineer - GPU Performance at Scale

NVIDIA Corporation • California

On-site
USD 184,000 - 287,500
Equity
Comprehensive benefits
Senior HPC Architect, Automation and At-Scale Deployment
Senior HPC Architect, Automation and At-Scale Deployment

NVIDIA Corporation • United States

On-site
USD 184,000 - 357,000
Equity
Benefits package
Senior HPC Architect - GPU Compute, Equity Eligible
Senior HPC Architect - GPU Compute, Equity Eligible

NVIDIA Corporation • California

On-site
USD 184,000 - 287,500
Equity
Inclusive work environment
Comprehensive benefits
Senior Systems Software Engineer, Workload Systems Engineering
Senior Systems Software Engineer, Workload Systems Engineering

NVIDIA Corporation • Santa Clara (CA)

Hybrid
USD 184,000 - 357,000
Equity
Benefits
Senior System Software Engineer, Performance - CUDA Driver
Senior System Software Engineer, Performance - CUDA Driver

NVIDIA Corporation • Santa Clara (CA)

Hybrid
USD 184,000 - 357,000
Equity
Benefits
Manager, GPU Accelerated Data Analytics
Manager, GPU Accelerated Data Analytics

NVIDIA Corporation • Santa Clara (CA)

Hybrid
USD 224,000 - 431,000
Equity
Benefits
Hybrid work