RAG Arcitect/Engineer

NTT DATA, Inc.; Dallas (TX); On-site; USD 140,000 - 200,000; Full time

Job summary

NTT DATA, Inc. in Dallas, TX seeks a RAG Architect/Engineer to lead enterprise GenAI solutions. You will design and implement vector databases, infrastructure, and scalable retrieval systems to support LLMs and AI agents.

Collaborate with product, data science, and software teams to deliver robust GenAI architectures. Role involves hands-on development, architectural leadership, and ensuring ethical AI practices while evaluating new GenAI models and tools to advance the organization’s AI

Qualifications

• 5+ years building enterprise AI applications with LLMs.
• 3+ years using pre-trained language models via APIs/frameworks.
• 3+ years using NLP libraries (NLTK, SpaCy, Gensim, BERT, SBERT).
• 5+ years Python in enterprise environments.

Responsibilities

• Design and optimize vector databases to support LLM models across GenAI tools.
• Architect, develop, and scale GenAI infrastructure for data storage, processing and retrieval.
• Lead architecture decisions with external GenAI providers to ensure scalable and cost-effective solutions.
• Collaborate with product owners and engineers to translate business needs into GenAI solutions.
• Drive model optimization and fine-tuning for large language models to improve performance.
• Present architectural designs to non-technical stakeholders; translate AI concepts into business insights.

Skills

LLMs & NLP understanding

RAG architectures

AI Agents

Python

GenAI infrastructure

LangChain / LangGraph / EmbedChain

Cloud platforms (Azure/AWS)

Education

Bachelor’s degree in Computer Science or Data Science

Tools

Hugging Face

LangChain

LangGraph

EmbedChain

Azure

AWS

Job description

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization,

We are currently seeking a RAG Arcitect/Engineer to join our team in Dallas, Texas (US-TX), United States (US).

As a RAG Architect / Engineer, you will be responsible for overseeing the design and implementation of enterprise-grade GenAI RAG solutions that solve complex business problems. You will work closely with product managers, software engineers, data scientists, and key stakeholders to conceptualize, prototype, test, and release robust GenAI solutions. In this dual role, you will act as both the technical authority and a core hands-on contributor across all aspects of our GenAI infrastructure, services, and structural vector databases.

Day-to-Day Job Duties:

• Design and optimize the foundational structure for vector databases to seamlessly accommodate LLM models across multiple enterprise GenAI tools.
• Architect, develop, and scale the infrastructure for GenAI systems, including data storage, processing, and high-performance retrieval mechanisms.
• Lead the technical decision-making process regarding architectural choices with external GenAI service providers (e.g., Microsoft Azure, AWS) to ensure solutions are scalable, maintainable, and cost-effective.
• Collaborate directly with Business Partners, product owners, and software engineers to translate complex business requirements into enterprise-level GenAI solutions.
• Drive model optimization and fine-tuning strategies for large language models to maximize performance, lower latency, optimize memory utilization, and increase throughput.
• Present and demo architectural designs and analysis results clearly to non-technical audiences, breaking down complex AI/ML concepts into actionable business insights.
• Identify use‑case‑specific data sources and design robust methods for data collection, integration, cleansing, and transformation in collaboration with data engineers.
• Partner with software engineering teams to integrate GenAI components into existing platforms, ensuring seamless communication and compatibility across software modules.
• Enforce ethical AI practices (fairness, transparency, and accountability) by actively identifying and mitigating biases or risks prior to deployment.
• Conduct proactive research and POC experimentation on the latest advancements in GenAI technologies, frameworks, and algorithms to continuously enhance Enterprise AI capabilities.
• Evaluate and benchmark emerging GenAI models while providing technical guidance, code reviews, and mentorship to development team members.
• Align and support the overall organization’s GenAI strategy and technology adoption roadmap.

Basic Qualifications:

• Minimum 5+ years of professional, practical experience building and deploying enterprise AI applications. Must have an advanced understanding of LLMs, NLP, and advanced ML algorithms, alongside extensive hands‑on experience designing RAG architectures and AI Agents.
• Minimum 3+ years of dedicated experience utilizing pre‑trained language models (e.g., GPT, BERT, RoBERTa) via APIs or frameworks like Hugging Face for downstream NLP production tasks.
• Minimum 3+ years of professional experience utilizing core NLP libraries (NLTK, SpaCy, Gensim, BERT, SBERT models) and modern orchestration frameworks (LangChain, LangGraph, or EmbedChain) to build and deploy GenAI applications.
• Minimum 5+ years of professional experience in Python (or similar enterprise programming languages), paired with excellent problem‑solving skills and the ability to drive results in a fast‑paced, collaborative team environment.

Degree:

Bachelor’s degree in Computer Science, Data Science, or equivalent practical work experience.

Nice‑to‑Have Qualifications:

• Proficiency in designing and deploying GenAI workloads using Azure or AWS Cloud Platforms.

About NTT DATA

NTT DATA is a $30 billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. We are one of the world's leading AI and digital infrastructure providers, with unmatched capabilities in enterprise‑scale AI, cloud, security, connectivity, data centers and application services. our consulting and Industry solutions help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have experts in more than 50 countries. We also offer clients access to a robust ecosystem of innovation centers as well as established and start‑up partners.NTT DATA is a part of NTT Group, which invests over $3 billion each year in R&D.

NTT DATA recruiters will never ask for payment or banking information and will only use @nttdata.com, @nttdatafed.com and @talent.nttdataservices.com email addresses. If you are requested to provide payment or disclose banking information, please submit a contact us form, https://us.nttdata.com/en/contact-us .

NTT DATA endeavors to make https://us.nttdata.com accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at https://us.nttdata.com/en/contact-us . This contact information is for accommodation requests only and cannot be used to inquire about the status of applications. NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. For our EEO Policy Statement, please click here . If you'd like more information on your EEO rights under the law, please click here . For Pay Transparency information, please click here .

Nearest Major Market: Dallas
Nearest Secondary Market: Fort Worth
Job Segment: Cloud, Developer, Computer Science, Testing, Consulting, Technology