Senior Custom Software Engineer - SAP Generative AI Solutions

Accenture India Private Limited; Bengaluru; On-site; INR 3,500,000 - 6,500,000; Full time

Job summary

Accenture India Private Limited is seeking a Custom Software Engineer for a project role to design, build, and deploy SAP GenAI-powered solutions across SAP landscapes, leveraging SAP BTP, AI Core, and Generative AI Hub.

You will architect end-to-end GenAI pipelines, integrate LLMs and retrieval systems, and guide multi-disciplinary teams to deliver scalable, compliant enterprise apps with measurable business impact.

Qualifications

• 15+ years of experience in AI-driven SAP solutions.
• Educational qualification: 15 years of full-time education.
• Experience with SAP BTP AI Core and GenAI.

Responsibilities

• Lead AI-driven solution design using Generative and Agentic AI.
• Serve as SME for SAP BTP and GenAI.
• Architect and implement Generative AI pipelines on SAP BTP.
• Design and manage RAG and GraphRAG workflows.

Skills

SAP BTP

GenAI

LLMs

RAG

LangChain

LangGraph

Vector Engines

Knowledge Graphs

CAP model

MLOps

Education

15 years education

Tools

Docker

Kubernetes

CI/CD

GitHub Actions

Job description

Custom Software Engineer Project Role :

Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : SAP Generative AI Good to have skills : NA Minimum 15 year(s) of experience is required Educational Qualification : 15 years full time education

Summary: We are seeking a forward-thinking professional with an AI-first mindset to to design, build, and operationalize enterprise-grade SAP GenAI solutions & experience with with the SAP Business Technology Platform (BTP) & other AI cloud platforms The ideal candidate will combine deep expertise in AI Core, Generative AI Hub, Large Language Models (LLMs), and Knowledge Graphs with hands-on experience orchestrating intelligent pipelines using LangChain / LangGraph frameworks, Vector Engines, and Retrieval-Augmented Generation (RAG) architectures. You will work with multi-disciplinary teams to embed Generative AI into SAP-centric business applications and processes, ensuring scalability, compliance, and measurable business impact. Prerequisite for RDE: Translate business processes into AI-driven workflows, integrating Agentic AI patterns and SAP s AI services to deliver scalable, intelligent, and automation-ready applications. Own end-to-end implementation, from data and model integration through solution architecture, development, testing, and deployment within SAP landscapes and customer environments. Collaborate cross-functionally with product, engineering, data, and customer teams to drive AI adoption, optimize models in production, and continuously enhance solution quality and impact. Experience with Transforming SAP Business processes with AI & infusing Agentic AI innovations in SAP space. Strategic thinking, client-focused articulation & effective demo/communication experience. Industry & Function Roles: SAP Process AI & Innovations Expert in Supply Chain or FI or Industry Space, Nice to have - Experience with BPM & tools like Signavio Good understanding of SAP standard AI features & setup For functional & industrial roles, a fair understanding of AI technologies and how it influences business processes SAP Certifications preferred - SAP Certified Associate - Positioning SAP Business AI Solutions as part of SAP Business Suite

Roles & Responsibilities:

• Lead AI-driven solution design and delivery using Generative and Agentic AI to solve complex business problems, automate processes, and integrate intelligent insights into enterprise operations for measurable impact.
• Serve as a Subject Matter Expert (SME) for SAP BTP and GenAI solutions.
• Building technical architecture design aligning with SAP and enterprise standards.
• Architect and implement Generative AI pipelines on SAP BTP, leveraging SAP AI Core, Generative AI Hub, and SAP HANA Cloud (Vector Engine + Knowledge Graph Engine).
• Design and manage RAG (Retrieval-Augmented Generation) and GraphRAG workflows to improve the grounding, accuracy, and interpretability of LLM outputs.
• Integrate Large Language Models (LLMs) and Foundation Models (FMs) with enterprise data sources through grounding modules, vector similarity search, and semantic search.
• Build Knowledge Graphs and ontologies to model enterprise domains and link contextual data for reasoning and relationship-aware GenAI applications.
• Develop LangChain / LangGraph-based orchestration pipelines for prompt templating, retrieval, generation, and post-processing.
• Implement data-masking, content filtering, and schema-based output parsing to ensure compliance, privacy, and structured response formats.
• Collaborate with development teams using SAP Cloud Application Programming (CAP) model to embed AI capabilities into cloud-native applications.
• Work with multitenant SaaS architectures ensuring secure tenant isolation and hyperscaler-agnostic deployments.
• Employ chunking, embedding generation, and vector store management to enable efficient information retrieval and contextualization.
• Optimize orchestration pipelines to handle prompt templating, query rewriting, and fusion techniques (e.g., Reciprocal Rank Fusion) for enhanced retrieval precision.
• Lead end-to-end lifecycle of GenAI projects—from model integration and fine-tuning in AI Core to deployment, monitoring, and continuous improvement.
• Collaborate and manage cross-functional teams to deliver high-impact solutions on time and within scope.
• Map business requirements to AI-powered solution architectures.
• Mentor and upskill team members through knowledge-sharing sessions and best practice frameworks.
• Ensure solution scalability, performance, and responsible AI usage principles are embedded throughout the development lifecycle.
• Track and report project progress, ensuring strategic alignment with business objectives.

Professional & Technical Skills:

• Deep understanding of SAP BTP services especially AI Core, Generative AI Hub, HANA Cloud (Vector Engine and Knowledge Graph Engine).
• Expertise with Large Language Models, Foundation Models, and LLM Orchestration Frameworks such as LangChain, LangGraph, or Semantic Kernel.
• Hands-on experience designing Retrieval-Augmented Generation (RAG) pipelines with embedding, chunking, and vector similarity search.
• Proficiency in Knowledge Graph design, GraphRAG, and ontology modelling using SAP HANA Cloud or graph databases.
• Strong grasp of data grounding, semantic enrichment, and enterprise contextualization.
• Experience with schema-based output parsing, prompt templating, and prompt-engineering best practices & AI evaluation frameworks.
• Familiarity with content filtering, data masking, and AI governance / compliance frameworks in enterprise environments.
• Working knowledge of CAP (Cloud Application Programming model) and SAP Extension Suite for integrating GenAI into enterprise apps.
• Understanding of vector stores, vector search, and semantic search APIs in HANA Cloud.
• Exposure to multi-tenant SaaS architecture, hyperscaler-agnostic deployments, and MLOps pipelines for AI solutions.
• Have handled deployment of large-scale SAP applications, infrastructure, data, integrations, and related systems.
• Expertise in application design principles, cloud-native development, and integration within SAP ecosystem.
• Familiarity with integration techniques and tools within the SAP ecosystem.
• Strong understanding of application design principles and methodologies.
• Ability to align AI capabilities with business objectives while ensuring scalability, responsible use, and tangible value realization.
• Ability to analyze and optimize application performance.

Additional Information:

• Sr. Manager: 16+ years of experience as solution architect driving SAP BTP & Gen AI initiatives.
• Completed minimum of 15 years of full-time education with Bachelor s or Master s (B.E./B.Tech/BCA/MCA) in Computer Science, IT, or Electronics & Communication from a recognized institution.
• Experience in Agentic development with A2A protocol with MCP server.
• Working knowledge of RDF, SPARQL, OWL or equivalent graph technologies.
• Familiarity with Docker, Kubernetes, and CI/CD automation (GitHub Actions, Jenkins, or SAP Continuous Integration Delivery).
• Knowledge of observability tools (Prometheus, Grafana) and tracing AI requests through pipelines.
• Experience deploying AI workloads with Terraform / BTP CLI / Kyma Runtime automation.
• Awareness of Responsible AI principles: transparency, explainability, fairness, and privacy.