HPC/AI Infrastructure Architect

The Nippon Telegraph and Telephone Corporation (NTT); City Of London; Remote; GBP 80,000 - 100,000; Full time

Job summary

A leading technology services provider in London is seeking an HPC/AI Infrastructure Architect to design and lead AI infrastructure solutions. This role requires over 8 years of experience in HPC/AI design and involves working on innovative projects with a focus on cutting-edge technology in a remote working environment. The ideal candidate will have a strong background in GPU architectures and demonstrate leadership in technical engagements.

Benefits

Opportunity to work on cutting-edge AI projects

Collaborative work environment

Access to advanced lab infrastructure

Qualifications

• 8+ years in HPC/AI infrastructure design.
• 5+ years working with GPU-accelerated systems.
• Proven experience with large-scale GPU deployments (1000+ GPUs).

Responsibilities

• Design GPU cluster architectures tailored for AI and HPC workloads.
• Lead technical discussions with customer architects.
• Deploy customer-specific AI workloads and manage PoC projects.

Skills

GPU Architectures

Interconnects

Storage Systems

Container Platforms

Performance Tools

Tools

Kubernetes

Docker

NVIDIA Nsight

Job description

Overview

Make an impact with NTT DATA. Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it's a place where you can grow, belong and thrive.

Your day at NTT DATA

We are seeking a highly skilled and visionary HPC/AI Infrastructure Architect - Pre-Sales Specialist to lead the technical design and architecture of large-scale AI infrastructure solutions. This role is pivotal in shaping next-generation AI Factories, supporting customer engagements, and driving technical excellence across compute, interconnect, and software stack domains.

Key Responsibilities

1. AI Factory Architecture & Design (35%)
   • Design GPU cluster architectures tailored for AI and HPC workloads.
   • Define node configurations for diverse workload types including dense GPU nodes, cost-optimized nodes, and high-memory CPU nodes.
   • Specify and validate performance metrics including compute throughput, memory bandwidth, and power consumption.
   • Architect multi-tier interconnect networks using NVLink, InfiniBand, and high-speed Ethernet.
   • Develop topology designs and calculate bandwidth and latency targets.
   • Model performance for customer workloads and validate against industry benchmarks.
2. Pre-Sales Technical Leadership (30%)
   • Lead technical discussions with customer architects and stakeholders.
   • Conduct workload sizing and architectural presentations.
   • Develop technical content for proposals including BoMs, compliance matrices, and scoring alignment.
   • Analyze competitor solutions and articulate technical differentiators.
3. Demonstrator Lab Development (20%)
   • Design and expand lab infrastructure for AI workload testing and validation.
   • Build reference architectures across industries such as finance, manufacturing, healthcare, and research.
   • Support lab operations including cluster configuration, workload orchestration, and software stack maintenance.
4. Customer Demonstrations & PoCs (10%)
   • Deploy and showcase customer-specific AI workloads including LLM training, computer vision, and scientific simulations.
   • Manage proof-of-concept projects, define success criteria, and present outcomes to stakeholders.
5. Technical Expertise & Innovation (5%)
   • Maintain relationships with key technology vendors and participate in early access programs.
   • Evaluate emerging technologies and contribute to innovation roadmaps and adoption strategies.

Required Skills & Experience

Technical Competencies

• GPU Architectures: NVIDIA (H100, H200, B100, B200), AMD (MI300X), Intel (Gaudi2/3)
• Interconnects: InfiniBand (HDR/NDR/XDR), NVLink, RoCE, Infinity Fabric
• Storage Systems: Lustre, GPFS, BeeGFS, NVMe-oF, S3-compatible object storage
• Container Platforms: Kubernetes, Docker, Singularity/Apptainer
• Performance Tools: NVIDIA Nsight, ROCm, Intel VTune

Certifications (Preferred)

• NVIDIA Deep Learning Institute (DLI)
• Red Hat Certified Specialist in OpenShift
• InfiniBand Certified Professional

Experience

• 8+ years in HPC/AI infrastructure design
• 5+ years working with GPU-accelerated systems
• Proven experience with large-scale GPU deployments (1000+ GPUs)
• Successful track record in technical bid support and customer engagement

What We Offer

• Opportunity to work on cutting-edge AI infrastructure projects
• Collaborative and innovative work environment
• Access to advanced lab infrastructure and vendor technologies
• Career development through technical leadership and innovation

Workplace type: Remote Working

About NTT DATA

NTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success. We invest over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure, and connectivity. We are also one of the leading providers of digital and AI infrastructure in the world. NTT DATA is part of NTT Group and headquartered in Tokyo.

Equal Opportunity Employer
NTT DATA is proud to be an Equal Opportunity Employer with a global culture that embraces diversity. We are committed to providing an environment free of unfair discrimination and harassment. We do not discriminate based on age, race, colour, gender, sexual orientation, religion, nationality, disability, pregnancy, marital status, veteran status, or any other protected category. Join our growing global team and accelerate your career with us. Apply today.

Third parties fraudulently posing as NTT DATA recruiters
NTT DATA recruiters will never ask job seekers or candidates for payment or banking information during the recruitment process, for any reason. Please remain vigilant of third parties who may attempt to impersonate NTT DATA recruiters-whether in writing or by phone-in order to deceptively obtain personal data or money from you. All email communications from an NTT DATA recruiter will come from an @nttdata.com email address. If you suspect any fraudulent activity, please contact us.