Gen AI Engineering Lead

Publicis Groupe Holdings B.V

Arlington (VA)

On-site

USD 180,000 - 240,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Publicis Sapient, part of Publicis Groupe, is seeking a hands-on Generative AI Engineering Lead in Arlington, VA. You will design and build enterprise AI solutions leveraging LLMs, RAG, and MCP integrations, while guiding a small engineering team.

You will collaborate with enterprise architects, architect scalable cloud-native AI, and drive production-grade implementations, ensuring security, governance, and operational excellence.

Qualifications

  • 8+ years of software, cloud, architecture, or AI/ML engineering experience.
  • Strong hands-on experience with Generative AI and LLM applications.
  • Proven ability to lead and mentor engineering teams.
  • Experience with LangChain and LangGraph for agentic workflows.
  • Experience with AWS cloud, Bedrock, and enterprise integration patterns.

Responsibilities

  • Lead design, development, and deployment of enterprise Generative AI solutions.
  • Own architecture decisions for LLM-powered applications and MCP integrations.
  • Develop reusable AI components, frameworks, and services across apps.
  • Provide day-to-day technical leadership and code reviews for a 3–5 engineer team.
  • Champion responsible AI practices and SDLC enhancements with AI acceleration.

Job description

Company description

Publicis Sapient is a digital transformation partner helping established organizations get to their future, digitally enabled state, both in the way they work and the way they serve their customers. We help unlock value through a start-up mindset and modern methods, fusing strategy, consulting, and customer experience with agile engineering and problem-solving creativity. United by our core values and our purpose of helping people thrive in the brave pursuit of next, our 20,000+ people in 53 offices around the world combine experience across technology, data sciences, consulting, and customer obsession to accelerate our clients’ businesses through designing the products and services their customers truly value.

Overview

We are seeking a highly technical and hands-on Generative AI Engineering Lead to lead the design, development, and operationalization of enterprise Generative AI solutions. This role combines deep Generative AI and LLM engineering expertise with strong AWS cloud and solution architecture capabilities and formal leadership responsibility for a team of approximately 3–5 engineers.

The Generative AI Engineering Lead will be responsible for designing and building production-grade AI solutions spanning Large Language Models (LLMs), AI agents, Retrieval-Augmented Generation (RAG), Model Context Protocol (MCP), semantic search, APIs, and cloud-native architectures. The individual will work closely with the Enterprise Architect to define new solutions, evolve existing architectures, establish engineering patterns, and ensure solutions align with enterprise architecture, security, governance, and operational requirements.

This is a hands-on engineering role. The successful candidate will be expected to contribute directly to solution architecture, application design, coding, prototyping, troubleshooting, code reviews, and technical delivery while providing day-to-day technical leadership to the engineering team.

The individual will also serve as an advocate for modern AI engineering practices and will champion the responsible use of Generative AI to accelerate the Software Development Life Cycle (SDLC) and improve engineering productivity.

Responsibilities
Generative AI Solution Engineering
  • Lead the architecture, design, development, and implementation of enterprise Generative AI and LLM-powered applications.
  • Build production-ready solutions using foundation models, prompt engineering, RAG, AI agents, semantic search, and related Generative AI patterns.
  • Evaluate model capabilities, limitations, and tradeoffs and recommend appropriate models and architectures based on business and technical requirements.
  • Develop reusable AI components, frameworks, patterns, and services that can be leveraged across multiple applications and use cases.
  • Maintain a strong hands-on engineering presence by developing application components, prototypes, integrations, APIs, and reference implementations.
AI Agents & Agentic Workflows
  • Design and implement agentic AI solutions capable of executing complex, multi-step workflows.
  • Build agent architectures incorporating:
    • Tool and function calling
    • Workflow orchestration
    • State and memory management
    • Planning and reasoning patterns
    • Human-in-the-loop workflows
    • Multi-agent collaboration
    • Error handling and recovery
  • Design and implement stateful and multi-agent workflows using LangChain and LangGraph.
  • Establish patterns for safely integrating autonomous and semi-autonomous AI agents into enterprise systems.
Retrieval-Augmented Generation (RAG)
  • Architect and implement end-to-end RAG solutions, including:
    • Document ingestion and preprocessing
    • Document parsing and chunking strategies
    • Embedding generation
    • Vector indexing
    • Semantic and similarity search
    • Metadata filtering
    • Hybrid retrieval
    • Reranking
    • Context construction
    • Grounded response generation
  • Optimize retrieval strategies to improve relevance, groundedness, accuracy, latency, and cost.
  • Design solutions that support appropriate data access controls and enterprise security requirements.
Model Context Protocol (MCP) & Enterprise Integration
  • Design and implement Model Context Protocol (MCP) integrations that securely connect AI agents and LLM applications with enterprise capabilities.
  • Develop patterns for exposing enterprise tools, APIs, applications, and data sources to AI agents.
  • Design appropriate authentication, authorization, access control, and security boundaries for AI-driven tool execution.
  • Establish reusable integration patterns for connecting AI solutions with existing enterprise platforms and services.
Python & Backend Engineering
  • Design and develop backend applications and services using Python and Flask or related Python frameworks.
  • Build REST APIs, microservices, AI services, and integration layers supporting Generative AI applications.
  • Develop robust production-quality code with appropriate testing, error handling, logging, security, and observability.
  • Lead code reviews and establish development standards and reusable engineering patterns.
  • Troubleshoot complex application, integration, model, and production issues.
Amazon Bedrock & AWS
  • Design and implement enterprise Generative AI solutions using Amazon Bedrock and related AWS services.
  • Work with Bedrock Foundation Models, Knowledge Bases, Guardrails, model APIs, and associated capabilities.
  • Architect secure, scalable, resilient, and highly available cloud-native AI solutions on AWS.
  • Design appropriate cloud architecture for compute, storage, networking, security, integration, monitoring, and deployment.
  • Optimize cloud and model infrastructure for performance, reliability, scalability, and cost.
Solution & Enterprise Architecture
  • Translate business requirements and use cases into scalable technical solutions and architectures.
  • Define:
    • System components and boundaries
    • Application and service interactions
    • Integration patterns
    • Data flows
    • AI/LLM architecture
    • Security controls
    • Deployment architecture
    • Technology selections
  • Partner closely with the Enterprise Architect on new solutions and enhancements to existing enterprise architecture.
  • Develop architecture diagrams, technical designs, decision records, and implementation guidance.
  • Communicate architecture decisions and technical tradeoffs effectively to engineering teams, architects, product stakeholders, and leadership.
  • Understand and communicate relevant industry best practices and emerging Generative AI architecture patterns.
Microservices & API Architecture
  • Design scalable distributed applications using microservices and API-based architectures.
  • Define REST API and service integration patterns for AI-enabled applications.
  • Apply appropriate resiliency patterns, including retries, timeouts, circuit breakers, asynchronous processing, and graceful failure handling.
  • Incorporate event-driven architectures where appropriate.
  • Ensure services are designed for scalability, security, maintainability, and observability.
AI Observability & Optimization
  • Establish monitoring and observability practices for production Generative AI applications.
  • Troubleshoot issues across prompts, models, retrieval pipelines, agent workflows, integrations, APIs, and infrastructure.
  • Analyze and optimize:
    • Model performance
    • Prompt effectiveness
    • Retrieval quality
    • Token utilization
    • Application latency
    • Reliability
    • Scalability
    • Infrastructure and inference costs
  • Define operational metrics and dashboards that provide visibility into the health and effectiveness of AI applications.
Enterprise AI Engineering & Responsible AI
  • Ensure Generative AI solutions meet enterprise requirements for:
    • Security
    • Data privacy
    • Access control
    • Governance
    • Responsible AI
    • Monitoring and auditing
    • Production readiness
  • Design appropriate guardrails and controls for enterprise AI applications.
  • Partner with architecture, security, platform, and governance teams to ensure solutions comply with organizational standards.
  • Identify and mitigate risks associated with model behavior, sensitive data exposure, prompt injection, unauthorized tool execution, and other emerging AI security concerns.
Technical & Team Leadership
  • Provide formal leadership for a team of approximately 3–5 engineers.
  • Lead technical planning, work decomposition, estimation, task assignment, and execution.
  • Provide hands‑on technical direction and unblock engineers when complex issues arise.
  • Mentor engineers and develop their Generative AI, cloud, architecture, and software engineering capabilities.
  • Conduct design and code reviews and ensure engineering deliverables meet established quality standards.
  • Establish engineering standards, reference architectures, reusable patterns, and development practices.
  • Balance delivery responsibilities with longer-term architectural quality and technical sustainability.
AI-Accelerated Software Development
  • Champion the responsible use of AI across the Software Development Life Cycle (SDLC).
  • Identify opportunities to apply AI to accelerate:
    • Requirements analysis
    • Solution design
    • Software development
    • Code reviews
    • Unit and integration testing
    • Documentation
    • Troubleshooting
    • Refactoring
    • DevOps and operational activities
  • Develop and promote effective AI-assisted engineering practices while maintaining appropriate human review, security, and quality controls.
  • Measure and communicate improvements in engineering productivity and software quality resulting from AI adoption.
Requirements
  • 8+ years of experience in software engineering, cloud engineering, solution architecture, AI/ML engineering, or related technical roles.
  • Significant hands-on software engineering experience using Python.
  • Strong experience designing and building backend services, REST APIs, microservices, and enterprise integrations using Flask or comparable Python frameworks.
  • Strong hands-on experience designing and developing Generative AI and LLM applications.
  • Demonstrated experience building agentic AI solutions, including tool/function calling, orchestration, state management, memory, and human-in-the-loop workflows.
  • Hands‑on experience with LangChain and LangGraph, including stateful agent workflows.
  • Strong experience designing and implementing production-grade RAG solutions.
  • Strong understanding of embeddings, semantic search, similarity search, vector databases, metadata filtering, reranking, and hybrid retrieval.
  • Experience implementing or integrating MCP-based solutions or comparable patterns for connecting AI agents to enterprise tools and systems.
  • Hands‑on experience with Amazon Bedrock and AWS-based Generative AI solutions.
  • Strong AWS cloud architecture experience, including designing secure, scalable, resilient, and highly available solutions.
  • Strong understanding of distributed systems, microservices, APIs, and enterprise integration patterns.
  • Experience defining and implementing LLM/RAG evaluation frameworks.
  • Experience troubleshooting and optimizing Generative AI applications across model behavior, retrieval, prompts, latency, reliability, token utilization, and cost.
  • Strong understanding of enterprise AI security, governance, privacy, responsible AI, and production operationalization.
  • Demonstrated ability to translate business requirements into end-to-end solution architectures and technical implementation plans.
  • Experience formally leading or providing technical leadership to engineering teams.
  • Ability and willingness to remain hands‑on with architecture, design, coding, prototyping, troubleshooting, and delivery.
  • Excellent communication skills with the ability to explain complex AI and architecture concepts to both technical and non-technical audiences.
  • Ability to understand, evaluate, and communicate emerging industry trends and best practices in Generative AI.
Preferred Qualifications
  • Experience leading teams of 3–5 software, cloud, or AI engineers.
  • Experience building and operating enterprise Generative AI applications in production.
  • Experience implementing multi-agent systems and complex LangGraph workflows.
  • Experience developing MCP servers, MCP clients, or enterprise MCP integration patterns.
  • Experience with multiple commercial and open-source foundation models and the ability to evaluate model tradeoffs based on use case, performance, security, latency, and cost.
  • Experience with vector database technologies and enterprise search platforms.
  • Experience with AWS serverless and container technologies, such as Lambda, ECS, EKS, API Gateway, and related services.
  • Experience with Infrastructure as Code, CI/CD, automated testing, and DevSecOps practices.
  • Experience implementing AI observability, tracing, evaluation, and monitoring platforms.
  • Understanding of emerging AI security risks, including prompt injection, data leakage, insecure tool execution, excessive agency, and model misuse.
  • Experience establishing reusable enterprise AI platforms, reference architectures, or engineering frameworks.
  • Experience implementing AI-assisted software engineering practices and measuring their impact on developer productivity and software quality.
  • Federal Government experience: Previous experience delivering technology, cloud, data, or AI solutions for U.S. Federal Government clients is highly desirable. Familiarity with Federal technology environments, security and compliance requirements,
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Engineer – Generative AI & Agentic AI
AI Engineer – Generative AI & Agentic AI

KData AI • United States

Remote
USD 120,000 - 180,000
AI Engineer – Generative AI & Agentic AI
AI Engineer – Generative AI & Agentic AI

KData Inc. • United States

On-site
USD 140,000 - 190,000
GenAI Engineer
GenAI Engineer

Capgemini • New York (NY)

On-site
USD 140,000 - 200,000
AI Architect – Generative AI & Agentic AI
AI Architect – Generative AI & Agentic AI

KData AI • United States

Remote
USD 140,000 - 210,000
Senior AI Platform & GenAI Engineer
Senior AI Platform & GenAI Engineer

Compunnel Inc. • Chicago (IL)

Hybrid
USD 180,000 - 260,000
AI Architect – Generative AI & Agentic AI
AI Architect – Generative AI & Agentic AI

KData Inc. • United States

Remote
USD 180,000 - 260,000
Sr Machine Learning Engineer
Sr Machine Learning Engineer

Compunnel Inc. • Chicago (IL)

On-site
USD 180,000 - 260,000
GenAI Lead
GenAI Lead

Globalpoint • Charlotte (NC)

On-site
USD 180,000 - 250,000
Lead AI Engineer
Lead AI Engineer

Mudals Technologies Private Limited • United States

Remote
USD 180,000 - 240,000
Senior AI Engineer - GenAI + Data Platform - AWS
Senior AI Engineer - GenAI + Data Platform - AWS

Compunnel Inc. • Los Angeles (CA)

On-site
USD 120,000 - 160,000