Senior Network Architect – AI Infrastructure

Nscale

Seattle (WA)

On-site

USD 120,000 - 160,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Nscale is hiring a Senior Network Architect in Seattle, WA, who will work closely with AI customers and hyperscale partners to design scalable, production-ready infrastructure. The ideal candidate will have 6–10+ years of experience in solutions architecture with a strong knowledge of GPU systems and distributed training. Responsibilities include engaging with clients, translating technical requirements, and aligning solutions with Nscale’s operational capabilities. If successful, you will ensure Nscale becomes a trusted long-term infrastructure partner.

Qualifications

  • 6–10+ years in solutions architecture or infrastructure engineering.
  • Strong knowledge of GPU-based systems.
  • Experience with backend networking and storage architectures.

Responsibilities

  • Engage AI-native startups and enterprises to translate requirements.
  • Architect end-to-end GPU cluster solutions.
  • Collaborate with hyperscalers on connectivity and deployments.

Skills

Solutions architecture
Infrastructure engineering
AI/HPC environments
GPU systems
Distributed training infrastructure
Technical communication

Tools

InfiniBand
RoCE
CUDA

Job description

About Nscale

Nscale is building high-performance GPU infrastructure purpose-built for AI. We partner with AI-native companies and hyperscalers to deliver scalable, reliable, and performant compute environments for training and inference at scale. Our customers are pushing the limits of distributed systems. We operate at the intersection of GPUs, high-speed networking, storage architecture, and production AI workloads.

The Role

We are hiring a Senior Network Architect to work directly with AI customers and hyperscale partners to translate workload requirements into scalable, production-ready infrastructure designs. You will bridge customer ambitions with Nscale’s capabilities—designing solutions across GPU compute, backend fabric, frontend networking, storage systems, and cluster architecture. This is a highly technical, customer-facing role requiring deep infrastructure knowledge and strong communication skills.

What You’ll Do
  • Customer Technical Discovery
    • Engage AI-native startups, enterprises, and hyperscalers to understand:
    • Training vs inference workloads
    • Model size and scaling strategy
    • Distributed training topology
    • Data pipeline and storage patterns
    • Performance, latency, and reliability requirements
  • Translate business and ML requirements into infrastructure specifications.
  • Solution Architecture & Design
    • Architect end-to-end GPU cluster solutions including:
    • GPU selection and sizing
    • Backend networking (InfiniBand / RoCE / Ethernet fabrics)
    • Frontend networking and connectivity
    • Storage (parallel file systems, object storage, NVMe tiers)
    • Rack density and data center constraints
    • Produce HLD/LLD documentation and reference architectures.
    • Validate feasibility within Nscale’s product and operational capabilities.
  • Hyperscaler & Partner Collaboration
    • Work with hyperscale partners to align on connectivity, interconnect, and hybrid deployments.
    • Design solutions that integrate with public cloud networking and storage architectures.
    • Evaluate peering, bandwidth, and redundancy requirements.
  • Internal Collaboration
    • Partner with infrastructure engineering, deployment, and operations teams to ensure designs are executable.
    • Provide feedback into product and platform roadmaps based on customer needs.
    • Support pre-sales efforts with technical validation and design assurance.
What We’re Looking For
  • 6–10+ years in solutions architecture, infrastructure engineering, or AI/HPC environments.
  • Strong knowledge of GPU-based systems and distributed training infrastructure.
  • Experience with backend networking (InfiniBand, RoCE, high-speed Ethernet).
  • Solid understanding of storage architectures for AI workloads.
  • Experience designing large-scale compute clusters.
  • Customer-facing experience with strong technical communication skills.
Preferred
  • Experience working with hyperscalers (AWS, Azure, GCP) or large colocation providers.
  • Familiarity with NCCL, RDMA, CUDA, and distributed training frameworks.
  • Experience producing formal architecture documentation.
  • Understanding of cost modeling and capacity planning.
What Success Looks Like
  • Customer requirements are translated into clear, scalable designs.
  • Proposed architectures are technically sound and executable.
  • Nscale wins complex AI infrastructure opportunities through technical credibility.
  • Customers trust Nscale as a long-term infrastructure partner.

For information on how Nscale handles candidate personal data, please see our Employee & Candidate Privacy Notice: Here.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Network Architect – AI Infrastructure
Senior Network Architect – AI Infrastructure

Nscale • United States

On-site
USD 120,000 - 150,000
Senior Network Engineer
Senior Network Engineer

Nscale • Seattle (WA)

On-site
USD 150,000 - 210,000
Principal Network Engineer
Principal Network Engineer

Nscale • Seattle (WA), New York (NY), San Francisco (CA), Houston (TX)

On-site
USD 180,000 - 240,000
Base salary + equity
Equity incentives
Dynamic progression plan
Senior AI Infrastructure Network Architect
Senior AI Infrastructure Network Architect

Nscale • United States

On-site
USD 120,000 - 150,000
Principal Front-End Network Engineer
Principal Front-End Network Engineer

Nscale • Houston (TX)

On-site
USD 150,000 - 260,000
Equity
Medical benefits
Retirement plan
+2
Principal Front-End Network Engineer
Principal Front-End Network Engineer

Nscale • San Francisco (CA)

On-site
USD 200,000 - 260,000
Medical, dental, vision coverage
Flexible paid time off
Parental leave
+1
Senior Network Engineer
Senior Network Engineer

Nscale • San Francisco (CA)

On-site
USD 150,000 - 210,000
Medical insurance
Retirement plan
Flexible PTO
Principal Front-End Network Engineer
Principal Front-End Network Engineer

Nscale • New York (NY)

On-site
USD 180,000 - 240,000
Equity
Medical, dental, vision insurance
Flexible paid time off
+2
Senior Network Engineer
Senior Network Engineer

Nscale • Houston (TX)

On-site
USD 150,000 - 210,000
Competitive benefits package
Flexible paid time off
Parental leave
+1
Principal Front-End Network Engineer
Principal Front-End Network Engineer

Nscale • Seattle (WA)

On-site
USD 180,000 - 260,000
Equity
Competitive salary
Career growth