AI Infra Ops Engineer: GPU Clusters & Hybrid Cloud

Accenture PLC; Boston (MA); On-site; USD 94,000 - 245,000; Full time

Benefits offered by this job

Medical benefits

401(k) plan

Bonus opportunities

Paid holidays

Paid time off

Job summary

Accenture is seeking a senior infrastructure engineer to design and operate large‑scale accelerated‑computing platforms for AI training and inference. You will deploy GPU clusters, automate provisioning and monitoring, and ensure governance, resiliency, and cost efficiency across on‑premises and cloud environments.

Responsibilities include building reusable automation, integrating with enterprise systems, and guiding capacity planning and performance validation for multi‑node workloads.

Qualifications

• Minimum 5+ years deploying accelerated‑computing infrastructure across on‑premises, cloud, and hybrid environments.
• t
• Minimum 5+ years hands‑on experience with GPUs, DPUs, CPUs and AI storage architectures.
• Minimum 5+ years of cluster management, workload scheduling, orchestration, observability, and automation.

Responsibilities

• Design accelerated‑computing infrastructure aligned to architecture, roadmaps, performance, scalability, and governance.
• Deploy and operate GPU clusters across bare‑metal and containerized environments using Kubernetes.
• Integrate infrastructure platforms with enterprise systems, data platforms, security, and governance controls.
• Develop reusable tools, scripts, and automation workflows for provisioning, configuration, validation, monitoring, and remediation.
• Establish repeatable processes for provisioning, configuration, patching, capacity planning, monitoring, and lifecycle management.
• Benchmark and validate GPU, compute, storage, and network performance; diagnose issues in multi‑node AI workloads.
• Create architecture diagrams, baselines, runbooks, and support docs.
• Provide guidance and optimization for GPU clusters with emphasis on availability, resiliency, scalability, energy efficiency, and cost management.

Skills

Kubernetes orchestration

Slurm

Run:AI

Python

Bash scripting

Terraform

Ansible

GPU clusters management

Cloud & hybrid environments

Education

Bachelor's degree or equivalent

Tools

NVIDIA BCM

NGC

NCCL

CUDA-X

NVAIE

Dynamo

Job description

Accenture is seeking a senior infrastructure engineer to design and operate large‑scale accelerated‑computing platforms for AI training and inference. You will deploy GPU clusters, automate provisioning and monitoring, and ensure governance, resiliency, and cost efficiency across on‑premises and cloud environments.

Responsibilities include building reusable automation, integrating with enterprise systems, and guiding capacity planning and performance validation for multi‑node workloads.