AI Infra Engineer: GPU, OpenShift & Observability

NTT DATA, Inc.; Charlotte (NC); On-site; USD 83,000 - 90,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

FSA/HSA

AD&D insurance

Employee assistance

401k plan

Voluntary benefits

Job summary

NTT DATA, Inc. in Charlotte, North Carolina is seeking an experienced Infrastructure Engineer to join our team.

You will lead complex infrastructure initiatives for Generative AI and Predictive AI platforms from design through production operations. You will act as technical lead for platforms supporting AI/ML model training, inference, and large GPU clusters, designing OpenShift-based containers and ensuring high performance and reliability.

Qualifications

• 5+ years infrastructure engineering experience.
• 5+ years troubleshooting end-to-end architectures (including CI/CD pipeline).
• 5+ years Linux systems experience.
• 4+ years supporting AI/ML platforms.
• 4+ years Kubernetes/container platform experience including production support.

Responsibilities

• Lead complex infrastructure initiatives supporting Generative AI and Predictive AI platforms from design to production operations.
• Serve as a technical lead for platforms supporting AI/ML model training, inference, and batch workloads.
• Design, build, deploy, and operate OpenShift-based container platforms optimized for high-performance GPU workloads.
• Build, support and operate scalable GPU SuperPod architecture with large multi-node GPU clusters.
• Own monitoring, alerting, and observability using Grafana, Splunk, and enterprise telemetry tools.
• Define SLIs/SLOs and build actionable alerts to proactively detect performance, capacity, and resiliency risks.
• Build AI- and agent-based automation tools for self-healing, scaling, diagnostics, and incident remediation.
• Apply AIOps techniques to reduce alert fatigue and improve platform reliability.
• Lead production incident analysis and ensure operational rigor and root-cause prevention.
• Mentor engineers and influence stakeholders across a geographically distributed organization.

Job description

NTT DATA, Inc. in Charlotte, North Carolina is seeking an experienced Infrastructure Engineer to join our team.

You will lead complex infrastructure initiatives for Generative AI and Predictive AI platforms from design through production operations. You will act as technical lead for platforms supporting AI/ML model training, inference, and large GPU clusters, designing OpenShift-based containers and ensuring high performance and reliability.