Senior Software Architect - Deep Learning and HPC Communications, Senior Software Architect - D[...]

NVIDIA; Hamburg; On-site; EUR 80,000 - 120,000; Full time

Benefits offered by this job

Competitive salary

Extensive benefits package

Diversity and inclusion initiatives

Job summary

A leading AI technology company in Hamburg is looking for a Senior Software Architect for Deep Learning and HPC Communications. This role involves designing innovative communication technologies and improving performance for AI and HPC workloads. Candidates should have a strong background in programming (C/C++) and systems architecture, along with advanced degrees in computer science or related fields. The position offers competitive salaries and a culture of diversity and inclusion.

Qualifications

• 3+ years of relevant experience.
• Ability to work effectively in a multi-national, multi-time-zone environment.

Responsibilities

• Investigate opportunities to improve communication performance.
• Design and implement new communication technologies.
• Build proofs-of-concept and conduct experiments.

Skills

C/C++ programming and debugging skills

Parallel programming models (MPI, SHMEM)

Deep understanding of operating systems

Network architecture and communication scaling

Solid experience with Linux

Collaborative and interpersonal skills

Education

M.S./Ph.D. degree in CS/CE or equivalent experience

Job description

Senior Software Architect - Deep Learning and HPC Communications

Join to apply for the Senior Software Architect - Deep Learning and HPC Communications role at NVIDIA

NVIDIA is leading groundbreaking developments in Artificial Intelligence, High Performance Computing and Visualization. The GPU – our invention – serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens new universes to explore, enables groundbreaking creativity and discovery, and powers inventions that were once considered science fiction, including artificial intelligence to autonomous cars.

What We Are Seeking

Come work for the team that brought to you NCCL, NVSHMEM & GPUDirect. Our GPU communication libraries are crucial for scaling Deep Learning and HPC applications! We're seeking a Senior Software Architect to help co‑design next‑gen data center platforms and scalable communications software.

What You Will Be Doing

• Investigate opportunities to improve communication performance by identifying bottlenecks in today's systems.
• Design and implement new communication technologies to accelerate AI and HPC workloads.
• Explore innovative solutions in hardware and software for our next generation platforms as part of co‑design efforts involving GPU, networking, and software architects.
• Build proofs‑of‑concept, conduct experiments, and perform quantitative modeling to evaluate and drive new innovations.
• Use simulation to explore performance of large GPU clusters (think scales of 100s and 1000s of GPUs).

What We Need To See

• M.S./Ph.D. degree in CS/CE or equivalent experience.
• 3+ years of relevant experience.
• Excellent C/C++ programming and debugging skills.
• Experience with parallel programming models (MPI, SHMEM) and at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC).
• Deep understanding of operating systems, computer and system architecture.
• Solid fundamentals of network architecture, topology, algorithms, and communication scaling relevant to AI and HPC workloads.
• Strong experience with Linux.
• Ability and flexibility to work and communicate effectively in a multi‑national, multi‑time‑zone corporate environment.

Ways To Stand Out From The Crowd

• Expertise in related technology and passion for what you do. Experience with CUDA programming and NVIDIA GPUs. Knowledge of high‑performance networks like InfiniBand, RoCE, NVLink, etc.
• Experience with Deep Learning Frameworks such as PyTorch, TensorFlow, etc. Knowledge of deep learning parallelisms and mapping to the communication subsystem. Experience with HPC applications.
• Strong collaborative and interpersonal skills and a proven track record of effectively guiding and influencing within a dynamic and multi‑functional environment.

Benefits & Culture

NVIDIA is at the forefront of breakthroughs in Artificial Intelligence, High‑Performance Computing, and Visualization. Our teams are composed of driven, innovative professionals dedicated to pushing the boundaries of technology. We offer highly competitive salaries, an extensive benefits package, and a work environment that promotes diversity, inclusion, and flexibility. As an equal opportunity employer, we are committed to fostering a supportive and empowering workplace for all.