Senior GPU Infrastructure Architect — Remote, Enterprise

Astir IT Solutions, Inc.

Pennsylvania

Remote

USD 170,000 - 240,000

Full time

42 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Astir IT Solutions, Inc. seeks a Lead Solution Architect for GPUaaS to drive large enterprise engagements, design scalable GPU infrastructure for production AI inference, and establish reference architectures.

You will lead POCs, benchmarks, sizing, and performance optimization, while advising executives on capacity and cost. Strong pre-sales, leadership, and GPU expertise are required; remote work is supported.

Qualifications

  • 15+ years in Enterprise Infrastructure, Cloud, or Solution Architecture.
  • 5+ years designing, deploying, or managing GPU clusters (Mandatory).
  • 1+ year selling GPU capacity, GPU Cloud, or AI infrastructure.
  • 2+ years of production LLM inference deployment and operations using vLLM, SGLang, TensorRT-LLM, or NVIDIA NIM.
  • Strong hands-on Python, Bash, Terraform, Ansible, and Helm.
  • Expertise in NVIDIA GPUs (H100/H200, B200) and AMD Instinct.
  • Strong experience with CUDA/ROCm, Linux, Docker, Kubernetes, and GPU Operator.
  • Knowledge of GPU networking, storage, and multi-GPU architectures.
  • Experience with GPU benchmarking, performance tuning, autoscaling, and multi-tenant environments.
  • Understanding AI data center infra, high-density power, liquid cooling, and capacity planning.
  • Experience with LLM optimization, model serving, token-based pricing, GPU sizing, and TCO.
  • Strong customer-facing pre-sales, solution selling, exec comms, and tech leadership.
  • Bachelor's degree in CS/Engineering or equivalent.

Responsibilities

  • Lead GPUaaS solution architecture for large enterprise engagements.
  • Design scalable GPU infrastructure and production AI inference solutions.
  • Lead technical POCs, GPU benchmarks, sizing, and performance optimization.
  • Advise executives on AI infrastructure strategy, GPU capacity, and costs.
  • Develop reference architectures and technical standards.
  • Collaborate with Sales, Product, NVIDIA, AMD, and partners.
  • Mentor architects and lead complex solution design reviews.

Skills

Python
Bash
Terraform
Ansible
Helm
CUDA/ROCm
Linux
Docker
Kubernetes
GPU infra design
Pre-sales
Executive communication

Education

Bachelor's degree in CS/Engineering

Tools

NVIDIA GPUs
InfiniBand networking

Job description

Astir IT Solutions, Inc. seeks a Lead Solution Architect for GPUaaS to drive large enterprise engagements, design scalable GPU infrastructure for production AI inference, and establish reference architectures.

You will lead POCs, benchmarks, sizing, and performance optimization, while advising executives on capacity and cost. Strong pre-sales, leadership, and GPU expertise are required; remote work is supported.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Solution Architect – GPUaaS
Lead Solution Architect – GPUaaS

Astir IT Solutions, Inc. • Pennsylvania

Remote
USD 170,000 - 240,000
Senior AI Solutions Architect - GPU Cloud Deployments
Senior AI Solutions Architect - GPU Cloud Deployments

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity compensation
Benefits
Senior AI Infra Architect - GPU Clusters (Remote)
Senior AI Infra Architect - GPU Clusters (Remote)

NVIDIA Corporation • United States

Remote
USD 184,000 - 357,000
Senior GPU Cluster Architect — Remote
Senior GPU Cluster Architect — Remote

Nebius Group • Oregon

Hybrid
USD 184,000 - 318,000
Health insurance
401(k) plan
Parental leave
+2
Senior AI GPU Cloud Architect – Enterprise Solutions
Senior AI GPU Cloud Architect – Enterprise Solutions

GMI Cloud • Mountain View (CA)

On-site
USD 190,000 - 260,000
Influence product roadmap
Career growth opportunities
Work with advanced AI organizations
GPU Cloud Solutions Architect — AI Infrastructure and Equity
GPU Cloud Solutions Architect — AI Infrastructure and Equity

NVIDIA Corporation • Texas

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior AI Inference Architect — Equity & Scalable GPU Solutions
Senior AI Inference Architect — Equity & Scalable GPU Solutions

2100 NVIDIA USA • Santa Clara (CA)

On-site
USD 184,000 - 356,000
Equity
Comprehensive benefits
Senior GPU AI Solutions Architect — GenAI & HPC
Senior GPU AI Solutions Architect — GenAI & HPC

NVIDIA • New York (NY)

On-site
USD 184,000 - 288,000
Equity
Benefits
Senior AI Solutions Architect - Cloud GPUs
Senior AI Solutions Architect - Cloud GPUs

NVIDIA Corporation • California

On-site
USD 184,000 - 288,000
Equity
Benefits
Senior Remote GPU Cluster Architect
Senior Remote GPU Cluster Architect

Orion Placement • United States

Remote
USD 180,000 - 240,000
Bonus
Equity
Remote work (nationwide)