Gen AI Engineer: Enterprise AI on Azure & LLMs (Hybrid)

Capgemini; New York (NY); Hybrid; USD 73,000 - 90,000; Full time

Benefits offered by this job

Paid time off

Medical, dental, and vision coverage

Retirement savings plans

Life and disability insurance

Employee assistance programs

Job summary

Capgemini is seeking a Gen AI Engineer to design, develop, and deploy enterprise AI solutions leveraging Azure AI Services, Copilot, and LLMs. The candidate will build production-grade systems with RAG architectures, vector databases, and agentic workflows while collaborating with stakeholders across the business.

Based in Whippany, NJ, onsite with hybrid from Day 1, you will mentor engineers, ensure governance and responsible AI practices, and deliver scalable AI services on Azure within

Qualifications

• 8+ years of software engineering with 3+ years focused on Generative AI.
• Strong experience with Azure AI Services, Azure OpenAI, Azure AI Foundry, and Microsoft Copilot.
• Hands-on experience building RAG-based applications and working with vector databases.
• Proficiency in Python and AI orchestration frameworks such as LangChain, LangGraph, Semantic Kernel, AutoGen, or CrewAI.
• Experience deploying AI applications using Azure cloud services and modern DevOps practices.
• Strong understanding of prompt engineering, model evaluation, AI observability, and responsible AI principles.
• Experience integrating AI solutions with enterprise systems and APIs.

Responsibilities

• Design and develop enterprise Generative AI solutions using LLMs and multimodal AI models.
• Build and optimize Retrieval-Augmented Generation (RAG) architectures using vector databases and enterprise knowledge repositories.
• Develop intelligent agents and agentic workflows using frameworks such as LangChain, LangGraph, Semantic Kernel, AutoGen, or CrewAI.
• Engineer prompts, guardrails, and evaluation frameworks to improve AI accuracy, reliability, and safety.
• Fine-tune, customize, and evaluate open-source and proprietary foundation models.
• Integrate AI solutions with enterprise applications, APIs, databases, Microsoft platforms, and business workflows.
• Develop scalable AI services and APIs for production environments on Azure.
• Establish AI governance, monitoring, security, compliance, and Responsible AI controls.
• Collaborate with architects, product managers, data scientists, and business stakeholders to deliver impactful AI solutions.
• Mentor junior engineers and promote AI engineering best practices across teams.

Skills

Generative AI

Azure AI Services

Python

RAG systems

Vector databases

LangChain

LangGraph

Semantic Kernel

AutoGen

CrewAI

Tools

LangChain

LangGraph

Semantic Kernel

AutoGen

CrewAI

Azure OpenAI

Azure AI Foundry

Job description

Capgemini is seeking a Gen AI Engineer to design, develop, and deploy enterprise AI solutions leveraging Azure AI Services, Copilot, and LLMs. The candidate will build production-grade systems with RAG architectures, vector databases, and agentic workflows while collaborating with stakeholders across the business.

Based in Whippany, NJ, onsite with hybrid from Day 1, you will mentor engineers, ensure governance and responsible AI practices, and deliver scalable AI services on Azure within