Infrastructure Architect

NTT DATA North America

Charlotte (NC)

On-site

USD 150,000 - 210,000

Full time

33 hours ago
Be an early applicant
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

NTT DATA North America is seeking an experienced Infrastructure Architect to lead the architecture of enterprise AI and cloud platforms across multiple locations including Charlotte, NC. You will drive strategy, governance, and scalable, secure infrastructure that supports high availability and disaster recovery.

The role requires deep expertise in cloud-native architectures, AI/ML platforms, distributed systems, and platform engineering, with the ability to influence roadmaps and partner with

Qualifications

  • Bachelor's degree or equivalent in a related field with extensive technical experience.
  • Minimum of 10 years in software or infrastructure roles, incl. cloud-native platforms.
  • At least 5 years designing large-scale cloud-native architectures and production systems.

Responsibilities

  • Provide architecture leadership for enterprise AI and cloud platform initiatives.
  • Lead multi-cloud strategy, capacity planning, and DR planning.
  • Guide platform engineering, governance, observability, and security practices.
  • Collaborate with cross-functional teams and stakeholders to shape roadmaps.

Skills

Kubernetes
OpenShift
Distributed systems
Cloud-native architectures
AI/ML platforms
API integration
Data-intensive applications

Education

Bachelor's degree in Computer Science, Information Systems, Engineering, or related field

Tools

Kubernetes
OpenShift
Public cloud platforms
AI infrastructure
API tooling
Data platforms

Job description

We are currently seeking a Infrastructure Architect to join our team in Bay Area, Charlotte, Dallas, Phoenix, NY, North Carolina (US-NC), United States (US).

Job Description: We are seeking an experienced AI Platform Architect to lead the technical architecture, strategy, and evolution of enterprise AI platforms. This role will provide architectural leadership for large-scale AI and cloud platform initiatives, partnering with engineering, infrastructure, security, product, and business stakeholders to deliver scalable, resilient, and secure AI capabilities. The successful candidate will demonstrate deep expertise in cloud-native architectures, AI/ML platforms, distributed systems, and platform engineering, along with the ability to influence technical roadmaps and lead cross-functional initiatives.

Key Responsibilities
  • Architecture Leadership
  • Lead architecture and technical direction for enterprise AI platform capabilities, including:
  • Enterprise Generative AI platforms
  • Agentic AI platforms and agent runtime environments
  • Model serving and inference infrastructure
  • Prompt engineering, evaluation, and testing frameworks
  • AI governance, risk management, and guardrails
  • AI observability, monitoring, and operations
  • Multi-cloud AI platform strategy and architecture
  • Platform Architecture & Design
  • Design, evaluate, and guide architecture across AI and cloud technologies such as:
  • Red Hat OpenShift AI (RHOAI)
  • Google Cloud Vertex AI
  • Gemini models
  • Azure AI Foundry
  • Amazon Bedrock
  • Anthropic Claude
  • OpenAI services and models
  • Cloud-native platform scalability and resiliency solutions
  • Strategic Initiatives
  • Lead and collaborate on initiatives involving:
  • Capacity planning and performance optimization
  • GPU infrastructure and platform strategy
  • Large-scale NVIDIA-based AI infrastructure architectures
  • Multi-region and multi-cloud resiliency
  • Disaster recovery planning and cloud DR strategies
  • Active-active platform architectures
  • High availability and business continuity solutions
Required Qualifications
  • Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field; or equivalent combination of education and relevant experience.
  • Minimum of 10 years of experience in software engineering, infrastructure engineering, systems architecture, or related technical disciplines.
  • Minimum of 5 years of experience designing and implementing large-scale cloud-native platforms.
  • Experience designing, deploying, and supporting highly available, mission-critical production systems.
Experience with:
  • Kubernetes and/or OpenShift
  • Distributed systems architectures
  • Public cloud platforms and cloud-native architectures
  • AI/ML platforms and infrastructure
  • API and integration platforms
  • Data platforms and data-intensive applications
Knowledge of:
  • Generative AI systems and architectures
  • Retrieval-Augmented Generation (RAG)
  • Agentic AI frameworks and platforms
  • Model serving and inference architectures
  • MLOps practices and tooling
  • Demonstrated ability to lead technical initiatives across multiple teams and stakeholders.
  • Ability to work from or relocate to one of the following approved locations: San Francisco Bay Area, CA; Charlotte, NC; Dallas, TX; Phoenix, AZ; or New York, NY.
Preferred Qualifications
  • Experience with one or more major cloud providers, including AWS, Azure, or Google Cloud Platform.
  • Experience architecting GPU-accelerated AI infrastructure.
  • Experience implementing AI governance, security, risk management, and compliance controls.
  • Experience building or supporting multi-region, highly resilient enterprise platforms.
  • Relevant industry certifications in cloud, AI/ML, Kubernetes, or architecture disciplines.
About NTT DATA:

NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. Visit us at us.nttdata.com

NTT DATA endeavors to make https://us.nttdata.com accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at https://us.nttdata.com/en/contact-us. This contact information is for accommodation requests only and cannot be used to inquire about the status of applications.

NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status.

For our EEO Policy Statement, please click here. If you'd like more information on your EEO rights under the law, please click here. For Pay Transparency information, please click here.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Infra Architect
Infra Architect

NTT DATA North America • Concord (CA)

Hybrid
USD 96,000 - 110,000
Medical insurance
Dental insurance
Vision insurance
+3
Infrastructure Architect (FTE / Hybrid)
Infrastructure Architect (FTE / Hybrid)

NTT DATA, Inc. • Concord (CA)

Hybrid
USD 121,000 - 182,000
Medical Insurance
Dental Insurance
Vision Insurance
+7
AI Architect
AI Architect

NTT DATA North America • Plano (TX)

Hybrid
USD 180,000 - 240,000
Infrastructure Architect (FTE / Hybrid)
Infrastructure Architect (FTE / Hybrid)

NTT DATA North America • Concord (CA)

Hybrid
USD 121,000 - 182,000
Medical Insurance
Dental Insurance
Vision Insurance
+6
AI Architect Lead Consultant
AI Architect Lead Consultant

NTT DATA North America • Philadelphia

Hybrid
USD 140,000 - 220,000
Principal Engineer
Principal Engineer

NTT DATA North America • Charlotte (NC)

Hybrid
USD 96,000 - 110,000
Medical, dental, vision insurance
401(k) program
AD&D insurance
Principal Engineer
Principal Engineer

Creative Solutions Services, LLC • Charlotte (NC)

On-site
USD 96,000 - 110,000
Medical, dental, and vision insurance
Flexible spending or health savings
AD&D insurance
+3
AI Architect
AI Architect

NTT DATA, Inc. • Dallas (TX)

On-site
USD 120,000 - 150,000
AI Architect Lead Consultant
AI Architect Lead Consultant

NTT DATA, Inc. • Philadelphia

On-site
USD 150,000 - 190,000
AI Architect - GTM
AI Architect - GTM

NTT DATA, Inc. • Plano (TX), Northern (KY)

Hybrid
USD 184,000 - 427,000
Medical, dental, and vision insurance
401k with company match
Paid time off