AI & HPC Infra Engineer — GPU-Accelerated Cloud

Accenture; Carmel (IN); On-site; USD 150,000 - 210,000; Full time

Job summary

Accenture in Carmel, IN is seeking a Senior AI Infrastructure Architect to design, deploy, and optimize scalable AI infrastructure across on-premises, cloud, and hybrid environments. You will lead architecture decisions for GPU-accelerated workloads, model serving, and agentic AI platforms, collaborating across teams to deliver high-performance compute at scale.

The role emphasizes governance, security, observability, and integration with existing data pipelines, with travel 25%–100% to meet

Qualifications

• Minimum of 5+ years designing, deploying, and managing AI infrastructure across on-prem, cloud, and hybrid.
• Hands-on experience with GPUs/DPUs/LPUs, NVMe storage, high-speed interconnects and data center networking.
• Experience with Kubernetes, Slurm, Run:ai and cloud platforms (AWS, Azure).

Responsibilities

• Design and implement AI infrastructure and accelerated computing solutions.
• Deploy, configure, and manage XPU-based clusters across bare-metal and containerized environments.
• Integrate AI infrastructure platforms with IT systems, data pipelines, and governance controls.
• Design agentic AI infrastructure with endpoints, tooling, and workflow orchestration.
• Build MCP servers, connectors, and adapters for monitoring, troubleshooting and tuning.
• Architect and deploy with NVIDIA tools to optimize performance for multi-node training and inference.
• Develop and maintain architecture diagrams, baselines, and runbooks.
• Provide guidance and optimization across AI workloads including large-scale training and inference.

Skills

AI infrastructure design

Accelerated computing

Kubernetes

Slurm

Run:ai

GPU management

DPU/LPU/CPU

High-performance networking

Tools

AWS

Azure

NVIDIA BCM

NCCL

TensorRT-LLM

Triton Inference Server

Job description

Accenture in Carmel, IN is seeking a Senior AI Infrastructure Architect to design, deploy, and optimize scalable AI infrastructure across on-premises, cloud, and hybrid environments. You will lead architecture decisions for GPU-accelerated workloads, model serving, and agentic AI platforms, collaborating across teams to deliver high-performance compute at scale.

The role emphasizes governance, security, observability, and integration with existing data pipelines, with travel 25%–100% to meet