AI Architect - Remote Role

NTT DATA, Inc.; Atlanta (GA); Remote; USD 124,000 - 165,000; Full time

Job summary

NTT DATA, Inc. seeks an experienced Enterprise AI Solutions Architect to define end-to-end AI architectures for large-scale deployments. You will lead designs for models, data, APIs, security, and cloud infrastructure, collaborating with AI engineers, data engineers, product, cloud, and security teams.

Responsibilities include governance, guardrails, performance evaluation, and guiding prototypes to production for enterprise RAG and multi-agent workflows.

Qualifications

• 8+ years of software engineering, data, cloud, AI/ML, or architecture experience.

Responsibilities

• Define end-to-end AI solution architecture, patterns, standards, and technical roadmaps for enterprise AI and Generative AI solutions.

Skills

Generative AI

LLMs

RAG

AI agents

Prompt engineering

Embeddings

Vector search

Cloud platforms

Education

Bachelor's degree in CS/AI/Engineering

Tools

Azure AI Foundry

OpenAI API

AWS

Azure OpenAI

Semantic Kernel

LangChain

Job description

Company Overview

Req ID: 393106

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization,

Job Description

In this role you will be responsible for:

• Define end-to-end AI solution architecture, patterns, standards, and technical roadmaps for enterprise AI and Generative AI solutions.
• Architect solutions using Large Language Models (LLMs), RAG, AI agents, prompt/context engineering, embeddings, vector search, APIs, and cloud AI services.
• Design scalable architectures across AI models, enterprise data, applications, APIs, security, integration, and cloud infrastructure.
• Lead architecture reviews and translate business and non-functional requirements into detailed technical designs and implementation guidance.
• Partner with AI Engineers, Data Engineers, Product, Cloud, and Security teams to guide solutions from prototype through production.
• Establish standards for AI security, governance, guardrails, evaluation, observability, performance, scalability, and Responsible AI.

Requirements for This Role Include

• 8+ years of software engineering, data, cloud, AI/ML, or architecture experience, including solution architecture responsibilities.
• Strong hands‑on experience with Generative AI, LLMs, RAG, AI agents, prompt/context engineering, embeddings, and vector search.
• Strong experience with Microsoft Azure AI/OpenAI, Azure AI Foundry, OpenAI, AWS, or similar enterprise AI/cloud platforms.
• Experience defining AI architecture patterns, security, governance, integrations, APIs, evaluation, and production deployment strategies.
• Bachelor's degree in Computer Science, Artificial Intelligence, Data Science, Engineering, or a related field, or equivalent professional experience.

Preferences

• Experience with Azure OpenAI, Azure AI Foundry, Semantic Kernel, LangChain, or similar AI frameworks.
• Experience architecting enterprise RAG solutions, AI agents, copilots, and multi‑agent workflows.
• Experience with AI evaluation, observability, guardrails, Responsible AI, model governance, and AI security.

About NTT DATA

NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. Visit us at us.nttdata.com

Where required by law, NTT DATA provides a reasonable range of compensation for specific roles. The starting hourly range for this remote role is ($90.00-$120.00/Hour). This range reflects the minimum and maximum target compensation for the position across all US locations. Actual compensation will depend on several factors, including the candidate's actual work location, relevant experience, technical skills, and other qualifications.

NTT DATA endeavors to make https://us.nttdata.com accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at https://us.nttdata.com/en/contact-us. This contact information is for accommodation requests only and cannot be used to inquire about the status of applications. NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. For EEO Policy Statement, please click here. If you’d like more information on your EEO rights under the law, please click here. For Pay Transparency information, please click here.