Lead Distributed AI Infrastructure Architect

NVIDIA

Germany (OH)

On-site

USD 221,250 - 383,500

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

A leading technology company is looking for a Senior HPC and AI Network Software Architect to build the next generation of scalable AI infrastructure. The role focuses on distributed training, real-time inference, and communication efficiency across large systems. Candidates should have a Ph.D. and over 5 years of experience in systems programming, with strong skills in C++, Python, and AI frameworks like TensorFlow. The position offers highly competitive salaries and a comprehensive benefits package.

Qualifications

  • 5+ years experience in systems programming or large-scale data movement.
  • Strong programming in C++, Python, and ideally CUDA.
  • Extensive hands-on experience with AI frameworks like PyTorch and TensorFlow.

Responsibilities

  • Build scalable software systems for distributed AI training.
  • Develop communication capabilities tailored to AI workloads.
  • Collaborate with AI framework teams to improve performance.

Skills

Systems programming
Parallel computing
Distributed computing
High-performance networking
C++
Python
CUDA
AI frameworks

Education

Ph.D. or equivalent

Tools

NCCL
UCX
UCC

Job description

A leading technology company is looking for a Senior HPC and AI Network Software Architect to build the next generation of scalable AI infrastructure. The role focuses on distributed training, real-time inference, and communication efficiency across large systems. Candidates should have a Ph.D. and over 5 years of experience in systems programming, with strong skills in C++, Python, and AI frameworks like TensorFlow. The position offers highly competitive salaries and a comprehensive benefits package.
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior AI Networking Architect — Scalable Inference
Senior AI Networking Architect — Scalable Inference

NVIDIA • California (MO)

On-site
USD 184,000 - 288,000
Senior AI Networking Architect — Scalable Inference
Senior AI Networking Architect — Scalable Inference

NVIDIA • California (MO)

On-site
USD 184,000 - 357,000
Lead AI Cluster Network Architect
Lead AI Cluster Network Architect

Cerebras • Sunnyvale (CA)

On-site
USD 150,000 - 200,000
Senior AI Networking Architect — Remote
Senior AI Networking Architect — Remote

NVIDIA Corporation • Austin (TX)

Hybrid
USD 184,000 - 357,000
Generous benefits package
Competitive salaries
Lead Architect, AI Networking & Distributed GPU Dataflow
Lead Architect, AI Networking & Distributed GPU Dataflow

NVIDIA • Austin (TX)

On-site
USD 272,000 - 432,000
Senior AI Networking Architect — Scalable Inference
Senior AI Networking Architect — Scalable Inference

NVIDIA • Austin (TX)

On-site
USD 184,000 - 288,000
Senior AI & HPC Communications Architect
Senior AI & HPC Communications Architect

NVIDIA • Durham (NC)

On-site
USD 120,000 - 160,000
Senior AI Network Architect – High-Perf Data Center Networks
Senior AI Network Architect – High-Perf Data Center Networks

ByteDance • San Jose (CA)

On-site
USD 208,000 - 616,000
Software Engineer, Scalable AI HPC Platform
Software Engineer, Scalable AI HPC Platform

Magic • United States

On-site
USD 200,000 - 550,000
Principal AI Infrastructure Architect - Hyperscale
Principal AI Infrastructure Architect - Hyperscale

Crusoe • San Francisco (CA)

On-site
USD 260,000 - 340,000
Industry-leading competitive pay
Significant equity options
Health insurance options
+4