Senior AI Network Architect for Scalable GPU Infrastructure

NVIDIA; Poland; On-site; PLN 221,000 - 507,000; Full time

Benefits offered by this job

Competitive salary

Comprehensive benefits package

Benefits portal access

Job summary

NVIDIA in Poland is seeking a Senior HPC and AI Network Software Architect to help build the next generation of scalable AI infrastructure, with emphasis on distributed training, real-time inference, and memory-efficient communication across large systems.

You will develop and evaluate next‑generation communication and runtime capabilities, collaborate with AI framework teams, and drive hardware-software co-design across GPUs, DPUs, and interconnects to accelerate training and inference at scale.

Qualifications

• Ph.D., or equivalent industry experience, in computer science, computer engineering, or a closely related field.
• 5+ years of experience in systems programming, parallel or distributed computing, high-performance networking, or large-scale data movement, including experience designing and building complex systems.
• Strong programming background in C++, Python, and ideally CUDA or other GPU programming models, with a track record of building production-quality performance‑critical software.
• Extensive hands‑on experience with AI frameworks (e.g., PyTorch, TensorFlow, JAX) and a solid grasp of how communication libraries and runtime systems facilitate large‑scale training and inference.
• Demonstrated success in developing and refining high‑throughput, low‑latency systems, including the ability to reason across software stacks, hardware capabilities, and system bottlenecks.
• Strong collaboration skills in a multi-national, interdisciplinary setting, with the ability to contribute ideas, build momentum, and work effectively with senior engineers, researchers, and partner teams.

Responsibilities

• Build and evolve the architecture of scalable software systems for distributed AI training and inference, focusing on throughput, latency, resiliency, and memory efficiency across cluster-scale deployments.
• Develop and evaluate next-generation communication and runtime capabilities in libraries such as NCCL, UCX, and UCC, tailored to the evolving demands of frontier AI workloads.
• Partner with AI framework teams (e.g., TensorFlow, PyTorch, JAX) and internal platform teams to build integrations, explore new approaches, and improve end-to-end performance and reliability.
• Collaborate on hardware and system-level features across GPUs, DPUs, and interconnects to speed up data movement and enable new capabilities for training, inference, and model serving at scale.
• Drive innovation across runtime systems, communication libraries, and AI-specific protocol layers, helping turn new ideas into practical capabilities and robust implementations.

Skills

C++

Python

CUDA

Education

PhD or equivalent

Tools

NCCL

UCX

UCC

Job description

NVIDIA in Poland is seeking a Senior HPC and AI Network Software Architect to help build the next generation of scalable AI infrastructure, with emphasis on distributed training, real-time inference, and memory-efficient communication across large systems.

You will develop and evaluate next‑generation communication and runtime capabilities, collaborate with AI framework teams, and drive hardware-software co-design across GPUs, DPUs, and interconnects to accelerate training and inference at scale.