Senior AI Architect: Production-Ready LLM & AI Pipelines

NTT DATA, Inc.; United States; Remote; USD 150,000 - 210,000; Full time

Job summary

NTT DATA, Inc. is seeking an experienced AI/ML Architect to lead the design and delivery of multi-product AI systems. You will own end-to-end architecture, mentor engineers, and collaborate with product teams to drive production-grade LLM/RAG pipelines across cloud providers.

Strong API, data flow, and security focus are essential, with excellent communication to stakeholders in English or Japanese. Join a global team building cutting-edge AI solutions for diverse industries, shaping scalable

Qualifications

• 5+ years software engineering experience with AI/ML focus.
• 2+ years leading AI/ML projects with a product mindset.
• Hands-on experience building production LLM/RAG pipelines.
• Experience with cloud AI services and multi-service architectures.
• Experience with agent frameworks and API design fundamentals.
• Strong mentoring and sprint leadership experience.
• Ability to communicate trade-offs to non-technical stakeholders.
• English or Japanese communication ability preferred.

Responsibilities

• Architect multi-product AI systems: APIs, data flows, cloud infra, security.
• Design shared AI service layers (OCR, NLP, embeddings, document parsing).
• Drive LLM/RAG/Agent pipeline design, prompt engineering, and model evaluation.
• Bridge Research PoCs into production-grade, deployable services.
• Own CI/CD pipeline health, code quality standards, and PR review process.
• Mentor engineers through code reviews and architecture discussions.

Skills

5+ years software engineering

2+ years AI/ML project leadership

Product mindset

Hands-on LLM/RAG pipelines

Cloud AI services experience

Agent frameworks experience

API design fundamentals

Mentoring engineers

Communicate technical trade-offs

English or Japanese communication

Tools

LangChain

LangGraph

LangFlow

Deep Agents

Google ADK

Claude Agent SDK

OpenAI AgentKit

Azure OpenAI

AWS Bedrock

Google Vertex AI

Cognitive Services

Job description

NTT DATA, Inc. is seeking an experienced AI/ML Architect to lead the design and delivery of multi-product AI systems. You will own end-to-end architecture, mentor engineers, and collaborate with product teams to drive production-grade LLM/RAG pipelines across cloud providers.

Strong API, data flow, and security focus are essential, with excellent communication to stakeholders in English or Japanese. Join a global team building cutting-edge AI solutions for diverse industries, shaping scalable