Solution Architect - NVIDIA Cluster (End-to-End Design & Validation)

WNTD; City Of London; Hybrid; GBP 80,000 - 100,000; Full time

Job summary

A technology solutions company is seeking a Solution Architect to design and validate NVIDIA GPU clusters in London. The role requires proven experience in AI/ML and HPC environments, strong communication skills, and offers a hybrid working model with one day per week onsite. This position involves technical leadership across deployment life cycles and collaboration with cross-functional teams to ensure scalability and performance.

Benefits

Hybrid working: 1 day per week in London

Opportunity to design next-gen high-performance GPU infrastructure

Exposure to cutting-edge AI compute at scale

Qualifications

• Proven experience architecting NVIDIA GPU clusters in AI, ML, and HPC environments.
• Strong hands-on understanding of NVIDIA GPU designs.
• Deep knowledge of high-performance networking architectures.

Responsibilities

• Lead architecture of NVIDIA GPU clusters and produce design documents.
• Define and execute GPU cluster validation test plans.
• Provide technical leadership across the deployment life cycle.

Skills

Architecting NVIDIA GPU clusters at scale

Understanding of GPU interconnects (NVLink/NVSwitch)

Deep knowledge of InfiniBand

Experience with cluster orchestration (Kubernetes)

Familiarity with AI/ML workload requirements

Communication skills

Critical-thinking abilities

Tools

CUDA Toolkit

Docker/OCI containers

Job description

Job Specification: Solution Architect - NVIDIA Cluster (End-to-End Design & Validation)

Location: London (1 day per week onsite)

Travel: Occasional travel to datacenter sites outside the UK

Engagement: Contract Inside IR35

Department: Engineering/Advanced Compute

Role Overview

We are seeking a highly skilled Solution Architect with deep experience in designing, validating, and delivering end-to-end NVIDIA GPU clusters in enterprise and hyperscale environments. This individual will own the full life cycle of architectural design—from requirements gathering through implementation oversight and performance validation. They will work closely with engineering, networking, DevOps, security, and datacenter operations teams to ensure high-performance, scalable, and resilient GPU infrastructure for AI, HPC, and ML workloads.

The role is primarily London-based one day per week, with occasional international travel required to support datacenter design reviews, deployment validation, or site acceptance testing.

Key Responsibilities

Architecture & Design

• Lead the architecture of NVIDIA GPU clusters leveraging technologies such as H100/H200, NVLink, NVSwitch, DGX, HGX, or SuperPod-class designs.
• Produce high-level and low-level designs (HLD/LLD), including compute, network, storage, and power/cooling considerations.
• Validate hardware and platform selections, ensuring architectural alignment with customer requirements and scalability goals.
• Design fabric architectures including InfiniBand (200/400Gb), RoCE, and high-performance east-west traffic patterns.
• Ensure designs adhere to NVIDIA reference architectures (NVAIE, Base Command, DGX SuperPod specs, etc.).

Cluster Integration & Validation

• Define and execute validation test plans for GPU cluster performance, resilience, networking throughput, and workload behaviour.
• Oversee integration of GPU nodes, networking, and storage systems into the existing datacenter environment.
• Collaborate with DevOps/Platform teams to validate cluster orchestration (Kubernetes, Slurm, Bright Cluster Manager, or equivalents).
• Validate firmware, drivers, NCCL, CUDA libraries, and container environments for production readiness.

Deployment & Delivery Oversight

• Provide technical leadership across the full deployment life cycle.
• Partner with datacenter operations to ensure correct rack layouts, cabling, airflow and power design.
• Support delivery teams during build-out phases, ensuring the design is executed correctly.
• Participate in factory acceptance tests (FAT), site acceptance tests (SAT), and operational readiness reviews.

Stakeholder Collaboration

• Work closely with internal and external teams including network engineering, platform engineering, procurement, and vendors such as NVIDIA, Mellanox, Supermicro, Dell, or HPE.
• Provide technical guidance to customers, partners, and cross-functional engineering teams.
• Communicate complex architectural concepts clearly to both technical and non-technical audiences.

Documentation & Governance

• Produce detailed architecture documents, diagrams, acceptance criteria, and operational runbooks.
• Ensure security, compliance, and governance standards are built into the design.
• Provide knowledge transfer (KT) and training sessions to internal teams where required.

Required Skills & Experience

Technical Expertise

• Proven experience architecting and delivering NVIDIA GPU clusters at scale (AI/ML/HPC environments).
• Strong hands-on understanding of GPU interconnects (NVLink/NVSwitch) and DGX/HGX/SuperPod architectures.
• Deep knowledge of InfiniBand and high-performance networking architectures.
• Experience with cluster orchestration: Kubernetes, Slurm, PBS, or similar.
• Familiarity with AI/ML workload requirements, CUDA, Docker/OCI containers, and NVIDIA software stacks (NCCL, CUDA Toolkit).
• Comfort with Linux systems engineering, hardware validation, and troubleshooting across compute/network layers.

Soft Skills

• Strong communication skills, with the ability to bridge engineering and business discussions.
• Comfortable owning architecture decisions and delivering executive-ready documentation.
• Ability to work autonomously while coordinating with multi-disciplinary teams.
• Problem-solver with strong critical-thinking abilities and a delivery-focused mindset.

Desirable Experience

• Experience with hyperscaler-class deployments or multi-megawatt datacenter environments.
• Work with NVIDIA Base Command Manager or similar cluster management tooling.
• Exposure to data pipelines, storage systems (Lustre, GPUDirect Storage, Ceph), or AI workflow platforms.
• Certifications such as NVIDIA Certified Associate/Expert, Kubernetes certifications (CKA/CKS), or related vendor accreditations.

What We Offer

• Hybrid working: 1 day per week in London
• Opportunity to design next-generation high-performance GPU infrastructure
• Exposure to cutting-edge AI compute at scale