Principal Data Scientist and AI Application Development Expert

Sap India Private Limited; Bengaluru; Hybrid; INR 5,500,000 - 7,500,000; Full time

Benefits offered by this job

Flexible working models

Health and well-being support

Job summary

SAP India Private Limited is seeking a Data and Applied Scientist Specialist/Expert to lead enterprise-grade AI/ML and Generative AI initiatives. You will architect scalable LLM applications, integrate advanced AI tooling, and drive governance, MLOps, and responsible-AI practices across cloud and SAP BTP environments.

Ideal candidates bring 14+ years in data science and enterprise architecture, strong NLP and knowledge of vector databases, with a track record of solving complex business problems

Qualifications

• 14+ years in Data Science, AI/ML, Generative AI, and Enterprise Architecture with a track record delivering production-grade LLM solutions.
• Degree in Computer Science, AI, Data Science, Engineering, or related field; PhD preferred for research-intensive profiles.
• Technical expertise: AI/ML: Deep learning, LLMs, Generative AI/foundation models, NLP/conversational AI, predictive analytics, recommendation systems; reinforcement learning (preferred).
• LLM & GenAI: Prompt engineering/optimization, RAG, AI agents/multi-agent systems, embeddings/semantic search, fine-tuning/adaptation, model evaluation/guardrails, LLMOps and observability.
• Frameworks & Tools: LangChain, LlamaIndex, Semantic Kernel, Hugging Face, OpenAI APIs; vector databases (Pinecone, Weaviate, ChromaDB, FAISS); TensorFlow, PyTorch, scikit-learn.
• Architecture & Platforms: Enterprise/solution architecture, distributed systems, microservices/APIs, cloud AI (AWS, Azure, GCP, SAP BTP), Kubernetes/Docker, CI/CD for AI.
• Programming & Data: Python, SQL, R; Spark/Databricks; data engineering and big-data ecosystems.
• Preferred: Publications, patents, open-source contributions, innovation/incubator or R&D experience. Hands‑on in GenAI transformation, enterprise search, copilots, or autonomous agents.
• Strong understanding of Responsible AI, governance, and AI security.

Responsibilities

• Lead architecture and delivery of enterprise-grade AI/ML and Generative AI solutions.
• Define enterprise AI/GenAI strategy aligned to business transformation, and evaluate foundation models, frameworks, and technologies.
• Design and implement scalable LLM applications and agentic systems; integrate vector stores, semantic search, prompt orchestration, tool calling, memory, and context-aware reasoning.
• Establish LLMOps practices for deployment, monitoring, observability, governance, and guardrails.
• Architect end-to-end AI platforms: data ingestion/processing, training/inference, orchestration frameworks, vector stores/embeddings, MLOps/LLMOps, security and compliance.
• Lead research and incubation: publish white papers, file patents, build PoCs/accelerators/reusable frameworks, collaborate with academia and cross-functional R&D teams.
• Drive stakeholder alignment and technical governance; mentor data scientists, ML engineers, prompt engineers, and solution architects.
• Partner with product, research, and business teams to deliver measurable business impact.

Skills

Data Science

AI/ML

Generative AI

Enterprise Architecture

NLP/Conversational AI

LLMs

RAG

Responsible AI

Executive storytelling

Education

Degree in Computer Science, AI, Data Science, Engineering, or related field; PhD preferred

Tools

LangChain

LlamaIndex

Semantic Kernel

Hugging Face

OpenAI APIs

Pinecone

Weaviate

ChromaDB

FAISS

TensorFlow

PyTorch

scikit-learn

Kubernetes

Docker

CI/CD for AI

Spark/Databricks

Python

SQL

R

Job description

Data and Applied Scientist Specialist/Expert

We help the world run better At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging - but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed.

What You Build

Lead architecture and delivery of enterprise-grade AI/ML and Generative AI solutions, including LLM-powered applications, intelligent assistants, and AI copilots. Define the enterprise AI/GenAI strategy aligned to business transformation, and evaluate emerging foundation models, frameworks, and technologies. Design and implement scalable LLM applications and agentic systems using commercial and open-source models; integrate vector databases, semantic search, prompt orchestration, tool/function calling, memory, and context-aware reasoning. Build robust RAG pipelines and knowledge retrieval systems; optimize prompts, inference, and evaluation frameworks; drive fine-tuning, alignment, and model optimization. Establish LLMOps practices for deployment, monitoring, observability, governance, and guardrails. Architect end-to-end AI platforms: data ingestion/processing, training/inference, orchestration frameworks, vector stores/embeddings, MLOps/LLMOps, Responsible AI, security, and compliance - across AWS, Azure, GCP, SAP BTP, and hybrid. Lead research and incubation: publish white papers, file patents, build PoCs/accelerators/reusable frameworks, and collaborate with academia, labs, startups, and cross-functional R&D teams. Drive stakeholder alignment and technical governance; mentor data scientists, ML engineers, prompt engineers, and solution architects; partner with product, research, and business teams.

What You Bring

• 14+ years in Data Science, AI/ML, Generative AI, and Enterprise Architecture with a track record delivering production-grade LLM solutions.
• Degree in Computer Science, AI, Data Science, Engineering, or related field; PhD preferred for research-intensive profiles.
• Technical expertise: AI/ML: Deep learning, LLMs, Generative AI/foundation models, NLP/conversational AI, predictive analytics, recommendation systems; reinforcement learning (preferred).
• LLM & GenAI: Prompt engineering/optimization, RAG, AI agents/multi-agent systems, embeddings/semantic search, fine-tuning/adaptation, model evaluation/guardrails, LLMOps and observability.
• Frameworks & Tools: LangChain, LlamaIndex, Semantic Kernel, Hugging Face, OpenAI APIs; vector databases (Pinecone, Weaviate, ChromaDB, FAISS); TensorFlow, PyTorch, scikit-learn.
• Architecture & Platforms: Enterprise/solution architecture, distributed systems, microservices/APIs, cloud AI (AWS, Azure, GCP, SAP BTP), Kubernetes/Docker, CI/CD for AI.
• Programming & Data: Python, SQL, R; Spark/Databricks; data engineering and big-data ecosystems.
• Preferred: Publications, patents, open-source contributions, innovation/incubator or R&D experience. Hands‑on in GenAI transformation, enterprise search, copilots, or autonomous agents.
• Strong understanding of Responsible AI, governance, and AI security.

Core strengths: Strategic, innovation-driven mindset; excellent problem-solving. Clear communication and executive-level storytelling. Influence across senior leadership and customers; commitment to continuous learning.

Success measures: Scalable AI/LLM solutions in production with measurable business impact. Innovation outcomes (adoption, reusability), research/patent contributions. Platform maturity: governance, reliability, cost/perf efficiency. Team capability growth and mentorship outcomes.

Where You Belong

Join SAP's PCP Cross Technology and Architecture unit - part of Private Cloud Products - driving technologies that empower innovation in business and for people. Be part of a dynamic, mission-driven team using AI to enable seamless interactions between individuals and information. Work in a collaborative, learning-oriented culture that values diverse perspectives and encourages experimentation. Thrive in a global, inclusive environment with opportunities to partner across regions and disciplines.

We win with inclusion SAP's culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone - regardless of background - feels included and can run at their best.

At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world. SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities.

Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, ethnicity, gender (including pregnancy, childbirth, et al), sexual orientation, gender identity or expression, protected veteran status, or disability, in compliance with applicable federal, state, and local legal requirements.

Successful candidates might be required to undergo a background verification with an external vendor.

AI Usage in the Recruitment Process For information on the responsible use of AI in our recruitment process, please refer to our Guidelines for Ethical Usage of AI in the Recruiting Process. Please note that any violation of these guidelines may result in disqualification from the hiring process.

Employment Type: Regular Full Time

Hybrid