Enterprise GenAI Architect: LLMs, RAG & Agents

Capgemini; New York (NY); Hybrid; USD 160,000 - 260,000; Full time

Job summary

Capgemini in NYC seeks an experienced Generative AI Architect to lead the design, development, and deployment of enterprise-scale AI solutions leveraging LLMs, RAG, Agentic AI, and AI-powered automation. Lead AI strategy, define standards, and collaborate with stakeholders to deliver scalable, secure, and responsible AI.

The candidate will architect cloud-native AI solutions on AWS/GCP, implement MLOps/LLMOps, and mentor teams across business and engineering functions.

Qualifications

• Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Data Science, or related field.
• 10+ years of software engineering, solution architecture, or data engineering experience.
• 3+ years in AI/ML architecture and GenAI solution design.
• Hands-on experience building enterprise-grade GenAI solutions.

Responsibilities

• Define and implement enterprise GenAI architecture and roadmap.
• Design scalable AI solutions using OpenAI, Azure OpenAI, Anthropic Claude, Gemini, and open-source LLMs.
• Evaluate emerging AI technologies and recommend adoption strategies.
• Establish AI governance, security, compliance, and responsible AI frameworks.
• Architect and implement RAG (Retrieval-Augmented Generation) solutions.
• AI Agents and Multi-Agent Systems.
• Conversational AI and Chatbots.
• Knowledge Management Solutions.
• Develop prompt engineering and prompt management strategies.
• Define scalable LLM orchestration patterns using LangChain, LlamaIndex, Semantic Kernel, AutoGen, CrewAI, or LangGraph.
• Architect cloud-native AI solutions on AWS.
• Design MLOps/LLMOps pipelines for deployment, monitoring, and optimization.
• Establish model observability, monitoring, and performance tracking frameworks.
• Optimize AI workloads for scalability, reliability, and cost efficiency.
• Develop secure AI architectures aligned with enterprise security standards.
• Implement data privacy controls, PII protection, model governance, and audit mechanisms.
• Ensure compliance with GDPR, HIPAA, SOC2, and Responsible AI principles.
• Partner with business leaders to identify GenAI opportunities.
• Translate business requirements into scalable technical solutions.
• Lead architecture reviews, design sessions, and technical governance meetings.
• Mentor AI engineers, architects, and development teams.

Skills

Generative AI

LLMs

AI Architecture

RAG

Agentic AI

MLOps

OpenAI GPT-4/4o

Azure OpenAI

LangChain

Semantic Kernel

LangGraph

REST APIs

Python

AWS

GCP

Education

Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Data Science, or related field

Tools

Elasticsearch

Pinecone

ChromaDB

Weaviate

Qdrant

Docker

Terraform

GitHub Actions

MLflow

AWS

GCP

Job description

Capgemini in NYC seeks an experienced Generative AI Architect to lead the design, development, and deployment of enterprise-scale AI solutions leveraging LLMs, RAG, Agentic AI, and AI-powered automation. Lead AI strategy, define standards, and collaborate with stakeholders to deliver scalable, secure, and responsible AI.

The candidate will architect cloud-native AI solutions on AWS/GCP, implement MLOps/LLMOps, and mentor teams across business and engineering functions.