Senior Solutions Architect, HPC and AI

NVIDIA Corporation

United States

Remote

USD 180,000 - 280,000

Full time

44 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

NVIDIA Corporation is seeking a Senior Solutions Architect to deploy, debug, and optimize training and inference workloads on large GPU clusters. The role involves collaborating with framework developers, assisting with deployment across NVIDIA platforms, and benchmarking performance to extract actionable insights.

You will work with external customers to resolve cluster bottlenecks and guide scaling of workloads on the latest NVIDIA GPUs, including participation in Europe’s Sovereign AI

Qualifications

  • BS, MS, PhD or equivalent experience in Computer Science, Electrical/Computer Engineering, Physics, Mathematics, or a related engineering field—or equivalent practical experience.
  • 8+ years of experience in accelerated computing technologies at cluster scale, ideally including work with NVIDIA platforms.
  • Strong programming skills in at least one of the following languages: C, C++, or Python.
  • Practical experience identifying and resolving bottlenecks in large-scale training workloads or parallel applications.
  • Hands-on experienced in profiling and debugging large parallel applications.
  • Solid understanding of CPU and GPU architectures, CUDA, parallel filesystems, and high-speed interconnects.
  • Experienced in working with large compute clusters with an understanding of their internal scheduling and resource management mechanisms (e.g. SLURM or Cloud based clusters).
  • Proficient knowledge of training pipelines and frameworks, encompassing their internal operations and performance attributes.

Responsibilities

  • Collaborating with NVIDIA’s training framework developers and product teams to stay ahead of the latest features and help partners to adopt them effectively.
  • Assisting with deployment, debugging, and improving the efficiency of AI workloads on extensive NVIDIA platforms.
  • Benchmarking new framework features, analyzing performance, and sharing actionable insights with both customers and internal teams.
  • Working directly with external customers to solve cluster performance and stability issues, identify bottlenecks, and implement effective solutions.
  • Build expertise and guide customers in scaling workloads efficiently and reliably on the latest generation of NVIDIA GPUs.
  • Contributing to Europe’s Sovereign AI initiative by helping customers implement advanced resiliency features within AI training pipelines.

Skills

C/C++/Python
GPU architectures
Performance profiling
Distributed systems
NVIDIA platforms

Education

BS/MS/PhD in CS/EE/Physics/Math

Tools

Nsight Systems
Nsight Compute
NCCL
MPI
SLURM

Job description

We are seeking a Senior Solutions Architect with strong hands-on experience in deploying, debugging, and optimizing training and inference workloads on large-scale GPU clusters. As we support customers and partners across Europe in training models on ground breaking GPU infrastructure, we are looking for someone who enjoys solving complex challenges at the intersection of High Performance Computing and AI. Similarly, inference is increasing in its complexity with explosion of MOE models and disaggregated execution making inference truly a HPC workload. You don’t need to have expertise in every skill we mention, but we are especially interested in candidates who bring deep knowledge in at least few key areas to enable large scale AI workloads. If you can demonstrate hands-on experience, we would love to hear from you.

What You’ll Be Doing:
  • Collaborating with NVIDIA’s training framework developers and product teams to stay ahead of the latest features and help partners to adopt them effectively.

  • Assisting with deployment, debugging, and improving the efficiency of AI workloads on extensive NVIDIA platforms.

  • Benchmarking new framework features, analyzing performance, and sharing actionable insights with both customers and internal teams.

  • Working directly with external customers to solve cluster performance and stability issues, identify bottlenecks, and implement effective solutions.

  • Build expertise and guide customers in scaling workloads efficiently and reliably on the latest generation of NVIDIA GPUs.

  • Contributing to Europe’s Sovereign AI initiative by helping customers implement advanced resiliency features within AI training pipelines.

What We Need To See:
  • BS, MS, PhD or equivalent experience in Computer Science, Electrical/Computer Engineering, Physics, Mathematics, or a related engineering field—or equivalent practical experience.

  • 8+ years of experience in accelerated computing technologies at cluster scale, ideally including work with NVIDIA platforms.

  • Strong programming skills in at least one of the following languages: C, C++, or Python.

  • Practical experience identifying and resolving bottlenecks in large-scale training workloads or parallel applications.

  • Hands-on experienced in profiling and debugging large parallel applications.

  • Solid understanding of CPU and GPU architectures, CUDA, parallel filesystems, and high-speed interconnects.

  • Experienced in working with large compute clusters with an understanding of their internal scheduling and resource management mechanisms (e.g. SLURM or Cloud based clusters).

  • Proficient knowledge of training pipelines and frameworks, encompassing their internal operations and performance attributes.

Ways To Stand Out From The Crowd:
  • Experience in debugging training pipelines running on thousands of GPUs in production environment.

  • Hands-on experience with performance profiling and optimizations using tools like Nsight Systems, Nsight Compute and good understanding of NCCL, MPI and low-level communication libraries.

  • Ability to debug stability issues across the entire stack: parallel application, training frameworks, runtime libraries, schedulers, and hardware.

  • Solid understanding of the internal workings of LLM frameworks such as PyTorch, Megatron-LM, or NeMo, and how they affect compute layers like CPUs, GPUs, network and storage or understanding of inference tools such as vLLM, Dynamo, TensorRT-LLM, RedHat Inference Server or SGLang.

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:
Germany: 112,200 EUR – 194,480 EUR for Level 4; and 141,900 EUR – 245,960 EUR for Level 5.
France: 93,750 EUR – 162,500 EUR for Level 4; and 123,000 EUR – 213,200 EUR for Level 5.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Solutions Architect – Large Scale AI Inference
Senior Solutions Architect – Large Scale AI Inference

NVIDIA Corporation • United States

On-site
USD 75,000 - 130,000
Senior Solutions Architect - AI Infrastructure
Senior Solutions Architect - AI Infrastructure

NVIDIA Corporation • New York (NY)

On-site
USD 184,000 - 356,500
Senior Solutions Architect - AI Infrastructure
Senior Solutions Architect - AI Infrastructure

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 287,500
Senior HPC & AI Solutions Architect (GPU Clusters, Europe)
Senior HPC & AI Solutions Architect (GPU Clusters, Europe)

NVIDIA Corporation • United States

Remote
USD 180,000 - 280,000
Senior Solutions Architect, Generative AI
Senior Solutions Architect, Generative AI

NVIDIA Corporation • California

Hybrid
USD 184,000 - 356,500
Senior Solutions Architect - AI Infrastructure
Senior Solutions Architect - AI Infrastructure

NVIDIA Corporation • California

On-site
USD 184,000 - 356,500
Senior Software Engineer, DGX Cloud AI Infrastructure
Senior Software Engineer, DGX Cloud AI Infrastructure

NVIDIA Corporation • United States

On-site
USD 184,000 - 357,000
Solutions Architect, NPN
Solutions Architect, NPN

NVIDIA Corporation • United States

Remote
USD 97,000 - 157,000
Equity
Benefits
Senior HPC Architect, Automation and At-Scale Deployment
Senior HPC Architect, Automation and At-Scale Deployment

NVIDIA Corporation • California

On-site
USD 184,000 - 287,500
Equity
Inclusive work environment
Comprehensive benefits
Senior Solutions Architect, AI Compute – NPN
Senior Solutions Architect, AI Compute – NPN

NVIDIA Corporation • United States

Remote
USD 184,000 - 357,000