Senior Architect - Server Performance

NVIDIA Gruppe; Bengaluru; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

NVIDIA Gruppe is seeking architects to drive architectural performance for next-generation AI server systems in Bengaluru, India. The role involves analyzing AI workloads, collaborating with cross-functional teams, and conducting performance evaluations.

The ideal candidate has 10+ years of experience in hardware architecture and expertise in networking technologies. Proficiency in C, C++, and Python is required, with a strong background in performance optimizations and benchmarking tools.

Qualifications

• 10+ years of practical experience in hardware architecture.
• Expertise in high-performance networking technologies.
• Strong ability to work within large, complex software repositories.

Responsibilities

• Analyze workloads on existing silicon for AI and HPC applications.
• Collaborate to define performance metrics and develop benchmarks.
• Conduct performance evaluations, identify bottlenecks, and recommend solutions.

Skills

Workload analysis

Silicon evaluation

Performance optimization

C

C++

Python

Education

Bachelor's or Master's degree in a relevant field

PhD

Tools

Benchmarking tools

Performance analysis tools

Job description

NVIDIA is seeking architects to drive architectural performance for its next-generation AI server systems. This position demands a unique capability to bridge deep architectural knowledge, workload analysis, and hands‑on silicon investigations. Candidates should be adept at working directly with silicon, high‑level models, and simulators. Responsibilities include conducting performance investigations on both NVIDIA and competitive platforms, and developing targeted microbenchmarks to examine specific architectural aspects. The role does not heavily involve modeling tasks (functional or performance), though occasional focused assignments may arise.

What you’ll be doing

• Analyze workloads of interest on existing silicon, with an emphasis on at-scale AI workloads and high-performance computing (HPC) applications.
• Collaborate with cross‑functional teams to define performance metrics and key use‑case scenarios, then develop robust tests and benchmarking methodologies.
• Conduct comprehensive performance evaluations, identify bottlenecks, and recommend effective solutions using appropriate tools and platforms.
• Utilize insights from workload analysis and silicon studies to propose architectural features that optimize system performance and scalability.
• Work closely with software and hardware teams to influence design choices that impact overall system performance.
• Act as a subject‑matter expert on system performance, providing guidance and support to the broader engineering team.
• Bridge architectural principles, workload understanding, and direct silicon evaluation to ensure NVIDIA’s AI server systems deliver cutting‑edge performance.

What we need to see

• Bachelor’s or Master’s degree in a relevant field; a PhD is a plus.
• 10+ years of practical experience in hardware architecture across areas such as CPU, GPU, cache, memory subsystem, PCIe, networking, or storage.
• Expertise in high‑performance networking technologies, including InfiniBand and RoCE, or a strong familiarity with communication libraries like MPI and UCX.
• Alternatively, a proven track record in performance optimizations for deep learning training or inference systems, high‑performance computing, or cloud computing environments.
• Expertise in benchmarking tools and methodologies, with demonstrated skill in developing and implementing targeted microbenchmarks.
• Solid understanding of performance analysis tools and techniques; experience with performance simulators is highly desirable.
• Proficiency in programming languages such as C, C++, and Python.
• Strong ability to work within large, complex, and unfamiliar software repositories.

We are an equal‑opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.