Senior Solutions Architect - AI Infrastructure Engineer

NVIDIA; Massachusetts; On-site; USD 184,000 - 288,000; Full time

Job summary

A leading company in GPU technology, NVIDIA is looking for a Senior Solutions Architect specializing in AI Infrastructure. In this role, you will optimize AI systems for academic institutions, utilizing expertise in high-performance computing. Join a team dedicated to advancing computational technologies and support groundbreaking research initiatives. You will enhance GPU-accelerated scientific workflows and help shape cutting-edge solutions in AI.

Benefits

Equity options

Comprehensive benefits package

Qualifications

• 8+ years of relevant work experience.
• Strong experience in designing/deploying GPU-accelerated computing infrastructure.
• Expertise in systems monitoring and optimization.

Responsibilities

• Collaborate on university-level research computing infrastructures.
• Implement systems monitoring and management tools.
• Document findings and gather feedback from researchers.

Skills

GPU-accelerated computing infrastructure

Cluster orchestration and job scheduling

System performance optimization

Monitoring and telemetry

Container tools (Docker, Singularity)

Networking technologies (InfiniBand, Ethernet)

Education

BS/MS/PhD in Engineering, Mathematics, Physical Sciences, or Computer Science

Tools

Prometheus

Grafana

NVIDIA Base Command

Ansible

OpenMPI

Job description

Senior Solutions Architect - AI Infrastructure Engineer

Join to apply for the Senior Solutions Architect - AI Infrastructure Engineer role at NVIDIA

Senior Solutions Architect - AI Infrastructure Engineer

1 day ago Be among the first 25 applicants

Join to apply for the Senior Solutions Architect - AI Infrastructure Engineer role at NVIDIA

Direct message the job poster from NVIDIA

Advocate for Inclusion | Investor | Board Member

Are you an experienced systems architect with an interest in advancing artificial intelligence (AI) and high-performance computing (HPC) in academic and research environments? We are looking for a Solutions Architect to join the higher education and research team! In this role you will work with universities and research institutions to optimize the design and deployment of AI infrastructure. Our team applies expertise in accelerated software and hardware systems to help enable groundbreaking advancements in AI, deep learning, and scientific research. This role requires a strong background in building and deploying research computing clusters, deploying AI and HPC workloads, and optimizing system performance at scale.

What You’ll Be Doing

• Collaborate as a key technical advisor for the design, build-out, and optimization of university-level research computing infrastructures powering GPU-accelerated scientific workflows
• Work with university research computing to optimize hardware utilization with software orchestration tools such as NVIDIA Base Command, Kubernetes, Slurm, and Jupyter notebook environments
• Implement systems monitoring and management tools to help optimize resource utilization, and gain insight into most demanding application workloads at research computing centers
• Document what you learn. This can include building targeted training, writing whitepapers, blogs, and wiki articles, and working through hard problems with a researcher on a whiteboard
• Collaborate with researchers to gather feature requests and product feedback for product and engineering teams
  
  

What We Need To See

• BS/MS/PhD in Engineering, Mathematics, Physical Sciences, or Computer Science (or equivalent experience).
• 8+ years of relevant work experience
• Strong experience in designing and deploying GPU-accelerated computing infrastructure
• In-depth knowledge of cluster orchestration and job scheduling technologies, e.g. Slurm, Kubernetes, Ansible and/or Open OnDemand
• Experience with container tools (Docker, Singularity) including at-scale deployment of containerized environments
• Expertise in systems monitoring, telemetry, and systems performance optimization of research computing environments. Familiarity with tools such as Prometheus, Grafana, and NVIDIA DCGM
• Understanding of datacenter networking technologies (InfiniBand, Ethernet, OFED) and experience with network configuration
• Familiarity with power and cooling systems architecture for data center infrastructure
  
  

Ways To Stand Out From The Crowd

• Background in deploying LLM training and inference workflows in a research computing environment
• Experience deploying and evaluating cluster performance using benchmarks such as MLPerf and/or HPL.
• Experience in delivering technical training, workshops, or mentoring researchers on using HPC/AI systems.
• Applications and systems-level knowledge of OpenMPI and NCCL
• Experience with debugging and profiling tools. E.g. Nsight Systems, Nsight Compute, Compute Sanitizer, GDB or Valgrind
  
  

The base salary range is 184,000 USD - 287,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits . NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

JR1998552

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Industries

  Computer Hardware Manufacturing, Software Development, and Computers and Electronics Manufacturing

Referrals increase your chances of interviewing at NVIDIA by 2x

Get notified about new Senior Solutions Architect jobs in Massachusetts, United States.

VP Solutions Architects / Systems Engineering

Massachusetts, United States $118,200.00-$191,290.00 1 week ago

Sr. Manager, Cloud Solutions Architect (REMOTE)

Boston, MA $124,000.00-$250,000.00 15 hours ago

Senior Solutions Architect, HPC Systems Engineer

Massachusetts, United States $224,000.00-$356,500.00 2 weeks ago

Director, Field Solutions Architect - AI/Analytics

Boston, MA $185,000.00-$296,000.00 2 weeks ago

Sr. Technical Solutions Architect (Cloud Data, Life Science, ELN/LIMS) - US Remote

Senior Solutions Architect, Spectrum-X – Switch-Centric

Massachusetts, United States $184,000.00-$356,500.00 2 weeks ago

Senior Solutions Architect (Post-Sales & Frontend Tech)

Boston, MA $145,000.00-$165,000.00 3 months ago

Solutions Architect, HPC Systems Engineer

Solutions Architect, Ethernet Networking - NVIS

Massachusetts, United States $148,000.00-$235,750.00 2 days ago

Waltham, MA $90,000.00-$175,000.00 1 day ago

Salesforce Solutions Architect (Technical Solutions Engineer)

Massachusetts, United States $220,900.00-$335,600.00 2 weeks ago

Senior Site Reliability / Gitops Engineer

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.