Senior Architect - Server Performance

NVIDIA; Hyderabad; On-site; INR 2,500,000 - 3,500,000; Full time

Job summary

NVIDIA is seeking a skilled architect in Hyderabad to enhance the performance of AI server systems. This role emphasizes deep architectural knowledge and hands-on experience with silicon. Responsibilities include analyzing workloads, collaborating with teams to define metrics, and conducting performance evaluations. Applicants should have over 10 years of experience, a degree in a relevant field, and proficiency in C, C++, and Python. Join us to innovate and drive cutting-edge technology in a diverse environment.

Qualifications

• 10+ years of practical experience in hardware architecture.
• Solid understanding of performance analysis tools and techniques.
• Expertise in benchmarking tools and methodologies.

Responsibilities

• Analyze workloads of interest on existing silicon, focusing on AI workloads.
• Collaborate with teams to define performance metrics and develop testing methodologies.
• Conduct comprehensive performance evaluations and recommend effective solutions.

Skills

Hardware architecture experience

Benchmarking tools expertise

High-performance networking technologies

Proficiency in C, C++, and Python

Education

Bachelor’s or Master’s degree in a relevant field

PhD in a relevant field

Tools

InfiniBand

RoCE

MPI

UCX

Performance simulators

Job description

NVIDIA has continuously reinvented itself. Our invention of the GPU sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. Today, research in artificial intelligence is booming worldwide, which calls for highly scalable and massively parallel computation horsepower that NVIDIA GPUs excel.

NVIDIA is a “learning machine” that constantly evolves by adapting to new opportunities that are hard to solve, that only we can address, and that matter to the world. This is our life’s work , to amplify human creativity and intelligence. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join our diverse team and see how you can make a lasting impact on the world!

NVIDIA is seeking architects to drive architectural performance for its next‑generation AI server systems. This position demands a unique capability to bridge deep architectural knowledge, workload analysis, and hands‑on silicon investigations. Candidates should be adept at working directly with silicon, high‑level models, and simulators. Responsibilities include conducting performance investigations on both NVIDIA and competitive platforms, and developing targeted microbenchmarks to examine specific architectural aspects. The role does not heavily involve modeling tasks (functional or performance), though occasional focused assignments may arise.

What You’ll Be Doing

• Analyze workloads of interest on existing silicon, with an emphasis on at‑scale AI workloads, and high‑performance computing (HPC) applications.
• Collaborate with cross‑functional teams to define performance metrics and key use‑case scenarios, then develop robust tests and benchmarking methodologies.
• Conduct comprehensive performance evaluations, identify bottlenecks, and recommend effective solutions using appropriate tools and platforms.
• Utilize insights from workload analysis and silicon studies to propose architectural features that optimize system performance and scalability.
• Work closely with software and hardware teams to influence design choices that impact overall system performance.
• Act as a subject matter expert on system performance, providing guidance and support to the broader engineering team.
• Bridge architectural principles, workload understanding, and direct silicon evaluation to ensure NVIDIA’s AI server systems deliver cutting‑edge performance.

What We Need To See

• Bachelor’s or Master’s degree in a relevant field; a PhD is a plus.
• 10+ years of practical experience in hardware architecture across areas such as CPU, GPU, cache, memory subsystem, PCIe, networking, or storage.
• Expertise in high‑performance networking technologies, including InfiniBand and RoCE, or a strong familiarity with communication libraries like MPI and UCX.
• Alternatively, a proven track record in performance optimizations for deep learning training or inference systems, high‑performance computing, or cloud computing environments.
• Expertise in benchmarking tools and methodologies, with demonstrated skill in developing and implementing targeted microbenchmarks.
• Solid understanding of performance analysis tools and techniques; experience with performance simulators is highly desirable.
• Proficiency in programming languages such as C, C++, and Python.
• Strong ability to work within large, complex, and unfamiliar software repositories.

NVIDIA is a technology leader, renowned for innovation and excellence. Our team thrives on creativity, determination, and a drive to solve complex problems. We seek individuals ready to push boundaries and transform the future. By joining NVIDIA, you will help advance agentic AI systems and shape a new era of computing, making a real impact at the cutting edge. If you’re inspired to grow and lead in groundbreaking advancements, we invite you to join our dynamic and visionary team.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.