Senior Developer - Python/LLMs/RAG/AI Agents (7-12 years)

SAP; Bengaluru; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

SAP in Bengaluru is seeking a highly skilled AI/ML engineer to architect and deliver AI-native systems. You will focus on scalable distributed architectures, LLM integration, and agentic workflows within SAP AI Core, leveraging Python as the primary language and CAP/Java for integration.

You will also help define robust evaluation frameworks and observability practices. You will collaborate with platform and AI teams to ensure production-ready solutions with strong scalability, resiliency, and

Qualifications

• Deep experience in distributed systems and scalable application design with hands-on skills in LLMs and agentic workflows.
• Experience building agentic workflows on SAP AI Core and integrating LLM-based features into CAP Java applications.
• Proficiency in system design for scale, resiliency, and fault tolerance is required.
• Strong experience in performance optimization, cost management, and troubleshooting complex production systems.

Responsibilities

• Independently design and architect scalable, AI-native application systems with advanced RAG pipelines and multi-agent workflows.
• Design and build AI agents integrated into SAP platforms using SAP AI Core and Python as primary language, CAP in Java as secondary.
• Develop ontology-grounded agents encoding accounting rules and ownership relationships for reliable reasoning.
• Build evaluation/benchmarking frameworks to measure AI system quality, including LLM-output validation against known formulas and rules.

Skills

LLMs

Agentic workflows

SAP AI Core

Python

CAP Java

System design for scale

Observability

OpenTelemetry

Multi-tenant SaaS

Tools

SAP AI Core

Python

CAP Java

Job description

We help the world run better At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed.

We help the world run better At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed.

What You’ll Bring

• You have deep experience in distributed systems and scalable application design, with strong hands‑on skills in LLMs, advanced RAG patterns, and agentic workflows.
• Experience building agentic workflows on SAP AI Core and integrating LLM‑based features into CAP Java applications is expected.
• Proficiency in system design for scale, resiliency, and fault tolerance is required.
• Strong experience in performance optimization, cost management, and troubleshooting complex production systems is essential.
• A solid understanding of SRE principles, observability (logs, metrics, tracing), and incident management is expected — including Open Telemetry instrumentation and SAP Cloud Logging dashboards.
• Experience designing evaluation frameworks for AI systems, validating model behavior, and applying agentic engineering patterns is critical.
• You use Claude‑style tools to generate code and ideas, but you read and challenge their output — you know when the AI is making the wrong call in both code and design.
• Familiarity with multi‑tenant SaaS architecture on SAP BTP (MTX, service‑manager, IAS/AMS) is a strong advantage.

Four Values Matter At Every Level

• Learning agility (non‑negotiable, and the most important value) — you rapidly pick up new models, frameworks, SAP Technologies, ontologies, and industry processes. You enjoy updating your mental model as the landscape shifts, which it will, frequently.
• Bias for action — you move quickly from ambiguity to a working prototype and learn through execution.
• Critical thinking — you ask the right questions, so we stay focused on the objective instead of just managing the day.
• End‑to‑end ownership — you own the outcome from problem definition through build, deployment, and evaluation.

What You’ll Build

• You’ll independently design and architect scalable, AI‑native application systems and components, including advanced RAG pipelines and multi‑agent workflows.
• You’ll design and build AI agents integrated into GHRA’s revenue accounting domain — including formula explanation, disposition computation assistance, and production volume analysis — using SAP AI Core and Python as primary programming language, CAP in Java will be secondary programming language.
• You’ll contribute to the design of ontology‑grounded agents for the domain, encoding accounting rules, formula structures, and ownership relationships as structured knowledge that agents can reason over reliably, rather than relying on prompt‑only approaches.
• Evaluation and benchmarking frameworks to measure AI system quality, reliability, and performance are things you’ll build and own. This includes domain‑specific test harnesses that validate LLM outputs against known good formula results and accounting rules — and the honest memo that explains why an idea shouldn’t ship.
• You’ll optimize latency, throughput, and cost efficiency across systems — including HANA Cloud query optimization and AI Core inference cost management.
• Observability and SRE practices, including monitoring, alerting, incident response, and root cause analysis, are areas you’ll implement and improve — specifically enabling OTEL tracing across the CAP microservice fleet and building Cloud Logging dashboards for cross‑service visibility.
• You’ll partner with platform, data, and AI teams to design robust, production‑ready solutions and improve system integration. System scalability, resilience, and maintainability are areas you’ll continuously work to strengthen.

Where you belong

If you need stable, well‑defined requirements before you can start, this role will be uncomfortable. If you’d rather supervise an AI than trust it blindly, and you want to be the technical bridge between a complex accounting domain and an AI platform, keep reading. You’ll take end‑to‑end technical ownership of critical systems and contribute to engineering excellence across the team. You’ll be the technical bridge between GHRA’s domain logic (royalty, production volumes, ownership allocation) and the AI platform layer — translating accounting business rules into context that agents can reason over reliably. Mentoring less‑experienced engineers, guiding design and code quality, and building strong technical capabilities within the team are all part of the role. The team operates across global, cross‑functional groups in a culture that values continuous improvement, operational excellence, and knowledge sharing. #SAPIndustryAICareers

Bring out your best

SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end‑to‑end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose‑driven and future‑focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best.

We win with inclusion

SAP’s culture of inclusion, focus on health and well‑being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.

SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e‑mail with your request to Recruiting Operations Team: [e-mail].

For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program, according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.

Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, ethnicity, gender (including pregnancy, childbirth, et al), sexual orientation, gender identity or expression, protected veteran status, or disability, in compliance with applicable federal, state, and local legal requirements.

Successful candidates might be required to undergo a background verification with an external vendor.

AI Usage in the Recruitment Process

For information on the responsible use of AI in our recruitment process, please refer to our Guidelines for Ethical Usage of AI in the Recruiting Process. Please note that any violation of these guidelines may result in disqualification from the hiring process.

Requisition ID: 458790 | Work Area: Software-Design and Development | Expected Travel: 0 - 10% | Career Status: Professional | Employment Type: Regular Full Time | Additional Locations: