Agentic AI Architect

Capgemini; New York, Northern (NY, KY); Hybrid; USD 170,000 - 250,000; Full time

Job summary

Capgemini is seeking an experienced Agentic AI Architect to lead design and implementation of enterprise-scale AI solutions. You will define architecture, guide development teams, and ensure secure, scalable AI systems leveraging LLMs and multi-agent frameworks.

The ideal candidate blends AI/ML expertise with software architecture and enterprise solution design, delivering production-grade systems across a global organization.

Qualifications

• Highly experienced AI architect with enterprise-scale design background.
• Proven track record delivering production-grade AI systems.
• Strong expertise in architecture, governance, security and compliance.

Responsibilities

• Define end-to-end architecture for enterprise Agentic AI solutions.
• Lead agent framework design and implementation for scalable deployment.
• Develop LLM-driven solutions and optimize model interactions.
• Architect RAG pipelines and memory/knowledge systems.
• Establish AI governance, security and responsible AI practices.
• Design enterprise integrations with CRM/ERP and APIs.
• Provide technical leadership and mentorship to teams.
• Collaborate with stakeholders to translate business needs into architecture.

Skills

AI/ML

Software architecture

Enterprise design

LLMs

Agent frameworks

LangChain

Semantic Kernel

Azure OpenAI

OpenAI

Knowledge systems

Tools

LangChain

Semantic Kernel

OpenAI

Azure OpenAI

CrewAI

Job description

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired bya collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizationsunlock the value of technology and build a more sustainable, more inclusive world.Location:Location: Charlotte, NC / NY/ Atlanta, GA/Chicago, IL

Role Overview

We are seeking a highly experienced Agentic AI Architect to lead the design and implementation of enterprise-scale Agentic AI solutions. This role will be responsible for defining architecture, guiding development teams, and ensuring secure, scalable, and high-performing AI systems that leverage Large Language Models (LLMs), multi-agent frameworks, and enterprise integrations. The ideal candidate combines deep expertise in AI/ML, software architecture, and enterprise solution design, with a proven track record of delivering complex, production-grade AI systems.

Job Description

AI Solution Architecture

• Define end-to-end architecture for enterprise Agentic AI solutions.
• Design multi-agent systems, orchestration layers, and enterprise integrations.
• Establish architectural standards, design patterns, and best practices.

Agent Framework Development

• Design and implement scalable agent frameworks using technologies such as:LangChainSemantic KernelAutoGenCrewAIOther emerging agent orchestration frameworksBuild robust and maintainable AI architectures capable of enterprise-scale deployment.

LLM & AI Engineering

• Lead the development of LLM-driven solutions using:Azure OpenAI OpenAI Anthropic Similar foundation model platforms
• Develop effective prompting strategies and optimize model interactions.
• Design solutions that maximize accuracy, performance, and reliability.

RAG & Knowledge Systems

• Architect and implement:Retrieval-Augmented Generation (RAG) pipelines
• Knowledge retrieval architectures
• Memory management systems
• Tool integration frameworks
• Enable AI agents to effectively access and utilize enterprise knowledge.

Governance, Security & Responsible AI

• Establish AI governance frameworks and standards.
• Implement Responsible AI principles and controls.
• Ensure compliance with security, privacy, and data governance requirements.
• Define risk management practices for enterprise AI solutions.

Enterprise Integration

• Design integration strategies with enterprise applications and platforms, including:CRM systemsERP platformsAPIsData platformsThird-party services
• Develop scalable and secure enterprise integration patterns.

Technical Leadership

• Provide technical leadership and mentorship to engineering teams.
• Guide architecture decisions and implementation approaches.
• Review code quality, scalability, and overall solution design.
• Drive engineering excellence and innovation across teams.

Stakeholder Collaboration

• Partner with business and technology stakeholders to translate business requirements into technical solutions.
• Communicate architectural strategies and implementation roadmaps to executive leadership.

Performance & Innovation

• Ensure AI systems meet targets for:PerformanceScalabilityReliabilityCost optimization
• Continuously evaluate emerging AI technologies, tools, and frameworks to drive innovation.

Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organizations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of 420,000 team members in more than 50 countries. We deliver end-to-end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering and business operations. The Group reported 2024 global revenues of €22.1 billion. Make it real | www.capgemini.com