Senior AI Infra & Edge Architect for GPU Open Models

Amazon Web Services (AWS); Miami (FL); On-site; USD 154,000 - 208,000; Full time

Job summary

Amazon Web Services (AWS) is seeking a Senior Solutions Architect to join the Worldwide Public Sector ISV Partner Solutions Architecture team, focused on accelerated computing, edge AI, and the open weight model ecosystem. You will architect GPU‑accelerated AI compute across cloud core, edge, and sovereign environments, collaborating with NVIDIA and partners to deploy open models.

The role requires guiding deployments, model optimization, and architecture reviews for mission‑critical AWS

Qualifications

• 3+ years of design, implementation, or consulting in applications and infrastructures.
• Experience in deploying LLMs in production on GPUs, Neuron, TPU or other AI acceleration hardware, or experience with PyTorch, JIT compilation, and AOT tracing.
• 8+ years of infrastructure architecture including high‑performance networking, distributed storage, and cluster management.

Responsibilities

• Own the technical relationship with accelerated computing and edge AI partners from first whiteboard session to production at scale.
• Design and architect GPU‑accelerated AI infrastructure on AWS, including multi‑node training clusters with EFA networking, high-performance storage, and container orchestration.
• Guide partners in deploying open weight foundation models across AWS environments, leveraging NVIDIA NIM microservices and inference servers.
• Architect edge and disconnected compute solutions for IL4/IL5/IL6 environments, enabling AI inference on Jetson/IGX platforms.
• Drive model optimization and right‑sizing engagements, including quantization and LoRA fine‑tuning.
• Serve as embedded technical advisor for partner engineering teams, conducting reviews and Well‑Architected assessments.
• Develop reusable technical content: reference architectures, deployment guides, and benchmarks for GPU workloads and edge inference patterns.

Skills

Kubernetes

ECS/EKS

GPU/accelerated computing

NVIDIA CUDA

TensorRT

Triton Inference Server

NVIDIA NIM

Jetson/IGX

Open weight models

Tools

NVIDIA NIM

Jetson/IGX

Job description

Amazon Web Services (AWS) is seeking a Senior Solutions Architect to join the Worldwide Public Sector ISV Partner Solutions Architecture team, focused on accelerated computing, edge AI, and the open weight model ecosystem. You will architect GPU‑accelerated AI compute across cloud core, edge, and sovereign environments, collaborating with NVIDIA and partners to deploy open models.

The role requires guiding deployments, model optimization, and architecture reviews for mission‑critical AWS