AI Architect

NTT DATA North America; Charlotte (NC); On-site; USD 150,000 - 200,000; Full time

Job summary

NTT DATA North America is seeking a Principal GenAI Architect in Charlotte, North Carolina. This role involves serving as the ultimate technical authority for GenAI architecture, leading the review of third-party AI integrations, and designing sophisticated systems like retrieval frameworks. Candidates should have extensive experience in programming, LLM optimization, Kubernetes, and GPU orchestration. This position offers an exciting opportunity to shape the future of AI solutions within a dynamic organization.

Qualifications

• 12–15 years of experience building large-scale distributed systems.
• 5–7 years of hands-on experience with LLM deployment strategies.
• 3–5 years experience in building complex agentic systems.
• 10–12 years of extensive experience with Kubernetes and cloud infrastructure.
• 8–10 years understanding of GPU resource management.
• 12–15 years ability to navigate complex organizations.

Responsibilities

• Serve as the ultimate technical authority for GenAI architecture.
• Lead architectural review for third-party AI integrations.
• Design frameworks that incorporate robust workflow logic.
• Architect sophisticated retrieval systems and agent data stacks.
• Implement solutions for externalized long-term memory and contextual data.

Skills

Programming proficiency (Python, Go, C++)

LLM inference optimization

Agentic architectures design

Kubernetes management

GPU orchestration

Strategic communication

Job description

Job Overview

Principal GenAI Architect – Charlotte, North Carolina, United States.

Key Responsibilities

• Serve as the ultimate technical authority for GenAI architecture across the enterprise, reviewing and guiding all AI/ML use cases.
• Push the boundaries of our technical vision, acting as a forward‑thinking catalyst for how GenAI is built and deployed.
• Lead the architectural review process for all third‑party AI integrations (e.g., ServiceNow, Five9, Pega), ensuring they meet strict security, performance, and integration standards.
• Spearhead the growth and development of our agentic stack, designing agentic frameworks that incorporate robust workflow logic.
• Architect sophisticated retrieval systems and agent data stacks, utilizing vector databases, hybrid search, BM25, and graph‑based reasoning.
• Implement solutions for externalized long‑term memory, contextual data freshness, and Model Context Protocol (MCP) servers.
• Lead prompt and context engineering strategies to maximize model accuracy and reliability.
• Design, implement, and scale high‑performance distributed systems and AI/ML platforms.
• Optimize LLM inference, implementing advanced batching, caching strategies, and load balancing techniques.
• Evaluate and implement dynamic deployment strategies, weighing the trade‑offs of deploying small/local LLMs at the edge versus leveraging hyperscaler inferencing via cloud APIs.
• Architect and test distributed API gateways across hybrid (cloud and on‑premise) environments.
• Oversee on‑premise hardware strategy, including rigorous GPU management, utilization, and thermal/compute optimization.

Minimum Qualifications

• Engineering Foundation: 12–15 years of experience with strong proficiency in at least one core programming language (e.g., Python, Go, C++) and deep experience building large‑scale distributed systems.
• GenAI & LLM Expertise: 5–7 years hands‑on, practitioner‑level experience with LLM inference optimization, fine‑tuning, and deployment strategies.
• Agentic Architectures: 3–5 years experience with a proven track record of building complex agentic systems, evaluation frameworks, and advanced retrieval pipelines (RAG, Vector DBs, Graph reasoning).
• Cloud & Infrastructure: 10–12 years extensive experience with Kubernetes, Cloud Infrastructure (AWS, GCP, or Azure), and managing high‑availability platforms.
• Hardware / On‑Premise Knowledge: 8–10 years experience and understanding of GPU orchestration, resource management, and hardware optimization in on‑premise or hybrid data centers.
• Strategic Communication: 12–15 years experience and ability to navigate a matrixed organization, translate complex technical trade‑offs to leadership, and rigorously evaluate third‑party enterprise platforms.

Nice to Have

• Domain experience in the Banking or Financial Services industry.
• Interest or hands‑on experience in integrating Blockchain technologies and decentralized frameworks.

EEO Statement

NTT DATA is an equal‑opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status.