Lead GenAI Engineer

Capgemini

Princeton (NJ)

On-site

USD 210,000 - 260,000

Full time

2 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Capgemini is seeking an experienced GenAI Solution Architect to design, architect, and lead enterprise-scale Generative AI and Agentic AI implementations on Microsoft Azure. The candidate will bring deep expertise in Azure AI Foundry, Azure OpenAI, Databricks, and responsible AI practices to deliver production-grade AI systems.

The role involves designing end-to-end architectures, multi-agent systems, RAG frameworks, and secure, scalable data products.

Qualifications

  • Over 10 years of software/architecture experience in enterprise settings.
  • 3+ years delivering Generative AI/LLM solutions in production.
  • Hands-on with Azure AI services and enterprise AI architectures.
  • Experience building agentic AI systems in production or pilots.
  • Collaborates with stakeholders including executives and clients.

Responsibilities

  • Design end-to-end Generative AI and Agentic AI solutions on Azure.
  • Architect multi-agent systems with planner-executor patterns.
  • Implement AI agents using Azure Foundry Agent Service and related tools.
  • Design RAG architectures with Azure Databricks Vector Search.
  • Integrate AI agents with enterprise apps via APIs and MCP.
  • Establish scalable AI architecture standards and governance.
  • Connect AI to enterprise data platforms like Unity Catalog and Delta Lake.
  • Develop LLMOps with MLflow, evaluations, and CI/CD pipelines.
  • Collaborate with data engineering to build governed data ecosystems.

Skills

GenAI
Azure AI Foundry
Agentic AI
RAG
MLOps
Databricks

Tools

Azure OpenAI
Semantic Kernel
LangGraph
AutoGen
MCP

Job description

We are seeking an experienced GenAI Solution Architect to design, architect, and lead the implementation of enterprise-scale Generative AI and Agentic AI solutions on Microsoft Azure. The ideal candidate will possess deep expertise in Azure AI Foundry, Azure OpenAI, Agentic AI frameworks, Databricks, cloud architecture, and Responsible AI practices, with a proven track record of delivering production-grade AI systems.

Key Responsibilities
  • Design end-to-end Generative AI and Agentic AI solutions leveraging Azure AI Foundry, including model selection, orchestration, retrieval, evaluation, deployment, and governance.
  • Architect multi-agent systems using planner-executor, supervisor, handoff, and human-in-the-loop patterns.
  • Implement AI agents using Azure AI Foundry Agent Service, Semantic Kernel, LangGraph, AutoGen, and similar frameworks.
  • Design Retrieval-Augmented Generation (RAG) architectures utilizing Azure AI Search, vector databases, semantic search, and Azure Databricks Vector Search.
  • Integrate AI agents with enterprise applications and services through MCP (Model Context Protocol), OpenAPI tools, Azure Functions, Logic Apps, API Management, and REST APIs.
  • Define scalable, secure, and maintainable AI architecture standards and best practices across projects.
  • Connect AI solutions to enterprise data platforms including Azure Databricks, Unity Catalog, Delta Lake, Vector Stores, Feature Stores, and Microsoft Fabric / OneLake.
  • Design semantic layers and AI-ready data products that enable reliable reasoning and decision-making by AI agents.
  • Establish LLMOps/MLOps frameworks leveraging MLflow, Azure AI Foundry Evaluations, Prompt Management, Model Versioning, and CI/CD pipelines.
  • Collaborate with data engineering teams to build governed data ecosystems that support AI applications.
Responsible AI, Security & Governance
  • Design and implement AI safety guardrails, including:
  • PII Detection and Redaction
  • Grounded Answer Validation
  • Toxicity and Hallucination Mitigation
  • Apply enterprise-grade security controls using:
  • Managed Identities
  • Key Vault
  • Private Networking
  • Azure Defender for Cloud
  • RBAC and Zero Trust principles
  • Implement observability and monitoring using Azure Monitor, Application Insights, Distributed Tracing, and Cost Management solutions.
  • Ensure compliance with enterprise security, governance, and regulatory requirements.
  • Support model governance and regulatory alignment with standards such as SOC 2, NYDFS Part 500, NAIC AI Model Bulletin, and Model Risk Management frameworks.
Required Technical Skills

Hands-on Production Experience

GPT Models, Function Calling, Structured Outputs, Prompt Engineering, Fine-tuning Fundamentals, Token Optimization

Hands-on Production Experience

Agentic AI

Multi-Agent Systems, MCP, A2A Communication, Memory, Planning, Tool Integration, Semantic Kernel, AutoGen, LangGraph

Hands-on

RAG & Search

Hands-on

Security & Identity

Entra ID, Managed Identities, Private Endpoints, VNETs, Key Vault, RBAC

Databricks

Unity Catalog, Delta Lake, MLflow, Mosaic AI, Vector Search, Model Serving

Preferred

Hands-on

Experience & Qualifications
Required
  • 10+ years of experience in Software Engineering, Data Engineering, Cloud Architecture, or Solution Architecture.
  • Minimum 3+ years of Azure Architecture experience in enterprise environments.
  • Proven experience delivering Generative AI and Large Language Model (LLM) solutions in production.
  • Hands-on experience implementing at least one Agentic AI system in production or advanced pilot stages.
  • Strong expertise in Azure AI Services, Azure OpenAI, and AI application architecture.
  • Experience working directly with business stakeholders, clients, and executive leadership.
Preferred
  • 1-2 years of experience with Azure Databricks, Unity Catalog, MLflow, Mosaic AI, and Vector Search.
  • Experience within consulting organizations, technology services firms, or large enterprise transformation programs.
  • Exposure to regulated industries such as Financial Services, Insurance, Healthcare, or Banking.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GenAI Solution Architect
GenAI Solution Architect

Centraprise • San Jose (CA)

On-site
USD 180,000 - 250,000
Senior AI Engineer - Generative AI & Agentic Systems
Senior AI Engineer - Generative AI & Agentic Systems

Life in Pittsburgh • Pittsburgh

On-site
USD 150,000 - 210,000
GenAI Engineer
GenAI Engineer

Capgemini • New York (NY)

On-site
USD 140,000 - 200,000
GenAI Architect
GenAI Architect

Capgemini • New York (NY)

Hybrid
USD 160,000 - 260,000
Generative AI Architect
Generative AI Architect

American IT Systems • Plano (TX)

On-site
USD 150,000 - 230,000
AI Architect - Azure
AI Architect - Azure

Software Technology Inc. • United States

On-site
USD 150,000 - 230,000
Sr. AI Architect
Sr. AI Architect

Ampcus, Inc • Chantilly (VA)

On-site
USD 180,000 - 260,000
AI / GenAI Architect / Sr. Lead (Contract)
AI / GenAI Architect / Sr. Lead (Contract)

TechDigital Group • Massachusetts

Hybrid
USD 150,000 - 210,000
GEN AI Architect
GEN AI Architect

TechDigital Group • Charlotte (NC)

On-site
USD 150,000 - 210,000
GenAI Architect
GenAI Architect

TechDigital Group • Charlotte (NC)

On-site
USD 180,000 - 240,000