AI Infrastructure Solutions Architect

MetroSys

United States

On-site

USD 180,000 - 260,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

MetroSys, Inc. seeks a Senior AI Infrastructure Solutions Architect to lead design, planning, and implementation of enterprise AI computing environments, combining GPU-accelerated infrastructure with HPC expertise.

You will shape architectures for on-premises, private cloud, and hybrid deployments, mentor engineers, and guide executive stakeholders through scalable solutions for LLMs, ML, and enterprise inference workloads.

Qualifications

  • 10+ years of experience in enterprise infrastructure architecture.
  • Experience designing complex data center or high-performance computing environments.
  • Strong knowledge of NVIDIA GPU computing technologies and enterprise AI infrastructure.
  • Experience with accelerated computing platforms, GPU cluster sizing, and capacity planning.
  • Advanced understanding of enterprise networking (InfiniBand, RoCE, high-speed Ethernet).
  • Proficiency with Linux, virtualization, containers, and Kubernetes.

Responsibilities

  • Design enterprise-scale infrastructure environments for AI, ML, and HPC workloads.
  • Develop architectures integrating GPU compute, high-throughput networking, storage, and orchestration tech.
  • Assess infrastructure requirements based on performance, scalability, and costs.
  • Produce architecture docs, diagrams, hardware specs, and implementation plans.
  • Lead discovery sessions and workshops to capture customer requirements and propose solutions.
  • Design for on-premises, private cloud, and hybrid AI environments.
  • Evaluate data center upgrades to support GPU-intensive computing.
  • Provide guidance on infrastructure security and governance.

Skills

Enterprise infrastructure architecture
GPU computing technologies
Kubernetes / container orchestration
Technical leadership / customer-facing
Solution design and architecture docs

Tools

NVIDIA DGX/HGX/MGX
InfiniBand / RoCE networking
NVIDIA Run:AI / Slurm / GPU scheduling
Red Hat OpenShift AI
Linux virtualization

Job description

Position Overview

MetroSys is seeking a highly experienced Senior AI Infrastructure Solutions Architect to support the design, planning, and implementation of advanced artificial intelligence computing environments for enterprise organizations.

This position requires a technical leader with extensive experience in GPU-accelerated infrastructure, high-performance computing (HPC), enterprise networking, storage architecture, and AI platform integration.

The ideal candidate will combine deep infrastructure engineering expertise with the ability to advise customers on complex technology investments, develop scalable solutions, and translate business requirements into practical architecture designs.

This individual will collaborate with engineering teams, technical stakeholders, and business leadership to develop infrastructure solutions capable of supporting demanding AI workloads, including large language models (LLMs), machine learning, model training, and enterprise inference applications.

The role requires both hands-on technical knowledge and the ability to lead architectural discussions with senior IT executives.

Key Responsibilities
Enterprise AI Infrastructure Architecture
  • Design enterprise-scale infrastructure environments supporting AI, machine learning, and high-performance computing workloads.

  • Develop architecture solutions integrating GPU compute platforms, high-throughput networking, enterprise storage, and workload orchestration technologies.

  • Evaluate infrastructure requirements based on application performance, scalability, resource utilization, and operational costs.

  • Produce technical architecture documentation, infrastructure diagrams, hardware specifications, and implementation plans.

  • Lead infrastructure discovery sessions and technical workshops to identify customer requirements and recommend appropriate solutions.

  • Design solutions supporting on-premises, private cloud, and hybrid AI computing environments.

  • Assess existing data center infrastructure and recommend upgrades necessary to support GPU-intensive computing.

GPU Computing and Accelerated Infrastructure
  • Architect solutions utilizing NVIDIA accelerated computing technologies and alternative GPU platforms.

  • Provide technical guidance on NVIDIA DGX, HGX, MGX, and enterprise GPU computing environments.

  • Evaluate NVIDIA Hopper and Blackwell architectures for AI training and inference requirements.

  • Design scalable GPU clusters supporting distributed computing and resource-intensive AI applications.

  • Support GPU platform sizing, performance analysis, capacity planning, and infrastructure optimization.

  • Evaluate AMD Instinct and Intel accelerator technologies when appropriate for customer workloads.

  • Assess infrastructure dependencies including rack density, power distribution, cooling, and physical data center capacity.

High-Performance Networking and Storage
  • Develop high-bandwidth network architectures designed for distributed GPU processing and AI applications.

  • Design and evaluate InfiniBand, RoCE, and high-speed Ethernet connectivity solutions.

  • Integrate high-performance storage platforms supporting large-scale data processing and model training.

  • Evaluate NVMe-based storage, parallel file systems, and distributed storage technologies.

  • Identify network and storage bottlenecks that could affect AI workload performance.

  • Collaborate with network, storage, and data center engineering teams to ensure infrastructure interoperability.

AI Platforms, Automation, and Workload Management
  • Design infrastructure platforms supporting containerized AI applications and distributed computing workloads.

  • Implement architectural solutions involving Kubernetes, Red Hat OpenShift AI, and Linux-based computing environments.

  • Evaluate workload management platforms including NVIDIA Run:ai, Slurm, and other GPU scheduling technologies.

  • Provide architectural guidance for NVIDIA AI Enterprise, NVIDIA NIM, NVIDIA Mission Control, and related AI infrastructure software.

  • Support integration of MLOps platforms used for model development, training, deployment, monitoring, and lifecycle management.

  • Develop infrastructure automation strategies to improve deployment consistency, operational efficiency, and resource utilization.

  • Assist with capacity planning and performance optimization for AI training and inference workloads.

Infrastructure Security and Governance
  • Incorporate enterprise security requirements into AI infrastructure architecture.

  • Design secure environments supporting sensitive datasets, proprietary AI models, and regulated workloads.

  • Implement architectural controls supporting workload isolation, identity management, access control, and infrastructure monitoring.

  • Evaluate security considerations associated with shared GPU resources and multi-tenant computing environments.

  • Collaborate with cybersecurity teams to align infrastructure solutions with applicable organizational and regulatory requirements.

  • Provide guidance on infrastructure logging, observability, auditability, and operational resilience.

Technical Consulting and Solution Development
  • Serve as a senior technical advisor during customer discovery, solution planning, and architecture engagements.

  • Translate complex business and technical requirements into actionable infrastructure recommendations.

  • Work with technical sales and delivery teams to develop solution designs, equipment requirements, implementation strategies, and project estimates.

  • Present proposed architectures to technical teams, IT leadership, and executive stakeholders.

  • Evaluate competing technology solutions and provide objective recommendations based on performance, cost, and business requirements.

  • Develop reusable technical documentation, architecture standards, and solution frameworks.

  • Provide technical leadership and mentoring to infrastructure engineers and architects.

  • Maintain awareness of emerging AI infrastructure technologies and evolving industry architecture practices.

Required Qualifications
  • 10+ years of experience in enterprise infrastructure architecture, solutions engineering, technical consulting, or related disciplines.

  • Significant experience designing complex data center or high-performance computing environments.

  • Strong knowledge of NVIDIA GPU computing technologies and enterprise AI infrastructure.

  • Experience with accelerated computing platforms, GPU cluster architecture, and infrastructure sizing.

  • Advanced understanding of enterprise networking, including high-speed Ethernet, InfiniBand, or RoCE.

  • Experience designing enterprise storage architectures for high-throughput and performance-sensitive workloads.

  • Strong knowledge of Linux operating systems, virtualization, containerization, and Kubernetes.

  • Familiarity with AI infrastructure software, GPU orchestration, and workload scheduling technologies.

  • Experience producing high-level designs, detailed technical specifications, and infrastructure implementation documentation.

  • Demonstrated ability to lead customer-facing technical discussions and communicate complex solutions to senior stakeholders.

  • Strong understanding of infrastructure scalability, availability, performance, and security principles.

  • Ability to collaborate across compute, storage, networking, security, and application engineering teams.

Preferred Qualifications
  • Experience with NVIDIA DGX, HGX, MGX, or comparable accelerated computing platforms.

  • Familiarity with NVIDIA AI Enterprise, NIM, Run:ai, Mission Control, and related technologies.

  • Experience with AMD Instinct GPU platforms or other accelerator architectures.

  • Knowledge of distributed AI training, inference optimization, and large language model infrastructure requirements.

  • Experience with Red Hat OpenShift AI or other enterprise Kubernetes environments.

  • Familiarity with Slurm and GPU resource scheduling platforms.

  • Experience supporting enterprise AI infrastructure deployments in regulated environments.

  • Understanding of NIST, FedRAMP, CMMC, or comparable security frameworks.

  • Experience with GPU-dense data center infrastructure, including power and cooling considerations.

  • Python scripting or infrastructure automation experience.

  • Relevant NVIDIA, cloud architecture, Linux, Kubernetes, or enterprise infrastructure certifications.

  • Experience supporting technical pre-sales engagements, solution development, or enterprise consulting initiatives.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Solutions Architect
AI Solutions Architect

Red8 • Houston (TX)

On-site
USD 180,000 - 220,000
AI Solutions Architect
AI Solutions Architect

Trick Dog Technology • Irvine (CA), Scottsdale (AZ), Houston (TX)

On-site
USD 180,000 - 240,000
Network and Compute Engineer, AI Infrastructure San Jose - CA - California
Network and Compute Engineer, AI Infrastructure San Jose - CA - California

Sierra Business Solution LLC • San Jose (CA)

On-site
USD 140,000 - 210,000
Senior Solutions Engineer, AI Infrastructure
Senior Solutions Engineer, AI Infrastructure

VAST Data • New York (NY)

On-site
USD 150,000 - 200,000
Principal AI Architect
Principal AI Architect

Government Acquisitions • United States

On-site
USD 180,000 - 280,000
Linux Infrastructure Engineer (Bare Metal, Storage & AI Factory Infrastructure)
Linux Infrastructure Engineer (Bare Metal, Storage & AI Factory Infrastructure)

Uvation • Las Vegas (NV)

On-site
USD 140,000 - 180,000
AI Infrastructure Lead
AI Infrastructure Lead

Blue Signal Search • California

On-site
USD 180,000 - 280,000
Equity participation
Leadership exposure
Ownership of infrastructure
Senior Solutions Architect, Cloud Infrastructure and DevOps - NVIS
Senior Solutions Architect, Cloud Infrastructure and DevOps - NVIS

NVIDIA Corporation • United States

Remote
USD 180,000 - 280,000
Remote - Lead GPU Cluster Solutions Architect
Remote - Lead GPU Cluster Solutions Architect

Orion Placement • United States

Remote
USD 180,000 - 240,000
Bonus
Equity
Remote work (nationwide)
Principal Infrastructure Engineer, AI Cluster Performance & Validation
Principal Infrastructure Engineer, AI Cluster Performance & Validation

Nscale • Houston (TX), New York (NY), San Francisco (CA), Seattle (WA)

On-site
USD 180,000 - 240,000