AI Infrastructure Engineer: GPU & OpenShift Lead

NTT DATA Deutschland; Charlotte (NC); On-site; USD 83,000 - 90,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401k program

Employee assistance

Job summary

NTT DATA Deutschland is seeking an Infrastructure Engineer to join our Charlotte, NC team. You will lead complex infra initiatives for Generative and Predictive AI platforms, design and operate OpenShift-based GPU workloads, and mentor engineers across a distributed organization.

You will own monitoring, SLIs/SLOs, and AIOps-driven reliability in a regulated enterprise environment. Ideal candidates have 5+ years in infrastructure, Linux, CI/CD, and Kubernetes, plus 4+ years in AI/ML platform

Qualifications

• 5+ years of infrastructure engineering experience.
• 5+ years troubleshooting complex end-to-end architectures (including CI/CD pipeline).
• 5+ years Linux systems experience.
• 4+ years supporting AI/ML platforms.
• 4+ years of Kubernetes / container platform experience including production support.

Responsibilities

• Lead complex infrastructure initiatives supporting Generative AI and Predictive AI platforms from design to production operations.
• Serve as a technical lead for platforms supporting AI/ML model training, inference, and batch workloads.
• Design, build, deploy, and operate OpenShift-based container platforms optimized for high-performance GPU workloads.
• Build, support and operate scalable GPU SuperPod architecture with large multi-node GPU clusters.
• Own monitoring, alerting, and observability using Grafana, Splunk, and enterprise telemetry tools.
• Define SLIs/SLOs and build actionable alerts to proactively detect performance, capacity, and resiliency risks.
• Build AI- and agent-based automation tools for self-healing, scaling, diagnostics, and incident remediation.
• Apply AIOps techniques to reduce alert fatigue and improve platform reliability.
• Lead production incident analysis and ensure operational rigor and root-cause prevention.
• Mentor engineers and influence stakeholders across a geographically distributed organization.

Job description

NTT DATA Deutschland is seeking an Infrastructure Engineer to join our Charlotte, NC team. You will lead complex infra initiatives for Generative and Predictive AI platforms, design and operate OpenShift-based GPU workloads, and mentor engineers across a distributed organization.

You will own monitoring, SLIs/SLOs, and AIOps-driven reliability in a regulated enterprise environment. Ideal candidates have 5+ years in infrastructure, Linux, CI/CD, and Kubernetes, plus 4+ years in AI/ML platform