GenAI Architect

Capgemini

New York (NY)

Hybrid

USD 160,000 - 260,000

Full time

8 hours ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Capgemini in NYC seeks an experienced Generative AI Architect to lead the design, development, and deployment of enterprise-scale AI solutions leveraging LLMs, RAG, Agentic AI, and AI-powered automation. Lead AI strategy, define standards, and collaborate with stakeholders to deliver scalable, secure, and responsible AI.

The candidate will architect cloud-native AI solutions on AWS/GCP, implement MLOps/LLMOps, and mentor teams across business and engineering functions.

Qualifications

Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Data Science, or related field.
10+ years of software engineering, solution architecture, or data engineering experience.
3+ years in AI/ML architecture and GenAI solution design.
Hands-on experience building enterprise-grade GenAI solutions.

Responsibilities

Define and implement enterprise GenAI architecture and roadmap.
Design scalable AI solutions using OpenAI, Azure OpenAI, Anthropic Claude, Gemini, and open-source LLMs.
Evaluate emerging AI technologies and recommend adoption strategies.
Establish AI governance, security, compliance, and responsible AI frameworks.
Architect and implement RAG (Retrieval-Augmented Generation) solutions.
AI Agents and Multi-Agent Systems.
Conversational AI and Chatbots.
Knowledge Management Solutions.
Develop prompt engineering and prompt management strategies.
Define scalable LLM orchestration patterns using LangChain, LlamaIndex, Semantic Kernel, AutoGen, CrewAI, or LangGraph.
Architect cloud-native AI solutions on AWS.
Design MLOps/LLMOps pipelines for deployment, monitoring, and optimization.
Establish model observability, monitoring, and performance tracking frameworks.
Optimize AI workloads for scalability, reliability, and cost efficiency.
Develop secure AI architectures aligned with enterprise security standards.
Implement data privacy controls, PII protection, model governance, and audit mechanisms.
Ensure compliance with GDPR, HIPAA, SOC2, and Responsible AI principles.
Partner with business leaders to identify GenAI opportunities.
Translate business requirements into scalable technical solutions.
Lead architecture reviews, design sessions, and technical governance meetings.
Mentor AI engineers, architects, and development teams.

Skills

Generative AI

LLMs

AI Architecture

RAG

Agentic AI

MLOps

OpenAI GPT-4/4o

Azure OpenAI

LangChain

Semantic Kernel

LangGraph

REST APIs

Python

AWS

GCP

Education

Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Data Science, or related field

Tools

Elasticsearch

Pinecone

ChromaDB

Weaviate

Qdrant

Docker

Terraform

GitHub Actions

MLflow

AWS

GCP

Job description

Job Title: Generative AI (GenAI) Architect

Location: NYC, NY (Hybrid)

Experience: 10+ Years in Software Engineering, Data & AI with 3+ Years in Generative AI, LLMs, and Enterprise AI Solutions

Job Summary

We are seeking an experienced Generative AI Architect to lead the design, development, and deployment of enterprise-scale AI solutions leveraging Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Agentic AI, and AI-powered automation. The ideal candidate will drive AI strategy, define architecture standards, and collaborate with business stakeholders, engineering teams, and leadership to deliver scalable, secure, and responsible AI solutions.

Key Responsibilities

AI Architecture & Strategy

Define and implement enterprise GenAI architecture and roadmap.
Design scalable AI solutions using OpenAI, Azure OpenAI, Anthropic Claude, Gemini, and open-source LLMs.
Evaluate emerging AI technologies and recommend adoption strategies.
Establish AI governance, security, compliance, and responsible AI frameworks.

Solution Design & Development

Architect and implement:
RAG (Retrieval-Augmented Generation) solutions
AI Agents and Multi-Agent Systems
Conversational AI and Chatbots
Knowledge Management Solutions
Develop prompt engineering and prompt management strategies.
Define scalable LLM orchestration patterns using LangChain, LlamaIndex, Semantic Kernel, AutoGen, CrewAI, or LangGraph.
Architect cloud-native AI solutions on:
AWS
Design MLOps/LLMOps pipelines for deployment, monitoring, and optimization.
Establish model observability, monitoring, and performance tracking frameworks.
Optimize AI workloads for scalability, reliability, and cost efficiency.

Security & Compliance

Develop secure AI architectures aligned with enterprise security standards.
Implement data privacy controls, PII protection, model governance, and audit mechanisms.
Ensure compliance with regulatory frameworks such as GDPR, HIPAA, SOC2, and Responsible AI principles.

Stakeholder Management

Partner with business leaders to identify GenAI opportunities.
Translate business requirements into scalable technical solutions.
Lead architecture reviews, design sessions, and technical governance meetings.
Mentor AI engineers, architects, and development teams.

Required Qualifications

Education

Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Data Science, or related field.

Experience

10+ years of software engineering, solution architecture, or data engineering experience.
3+ years in AI/ML architecture and GenAI solution design.
Hands-on experience building enterprise-grade GenAI solutions.

Technical Skills

Generative AI & LLMs