Senior Developer - Python/LLMs/RAG/AI Agents (7-12 years)

SAP SE; Bengaluru; On-site; INR 3,000,000 - 6,000,000; Full time

Job summary

SAP Bangalore is seeking a Senior Developer - Python/LLMs/RAG/AI Agents with 7-12 years of experience to design and build AI-native, scalable systems. You will architect and implement advanced RAG pipelines and agentic workflows, integrate LLM features into CAP Java apps, and drive performance, reliability, and cost optimization at scale.

You will champion observability, SRE practices, OTEL tracing, and production readiness while collaborating with platform, data, and AI teams to deliver robust,

Qualifications

• Experience in distributed systems and scalable design for AI-native apps.
• Proven work with LLMs, advanced RAG patterns, and agentic workflows.
• Experience integrating AI features into CAP Java apps and SAP platforms.

Responsibilities

• Design and architect AI-native, scalable systems with advanced RAG pipelines and multi-agent workflows.
• Integrate AI agents into domains using SAP AI Core and Python/CAP Java as needed.
• Encode accounting/business rules into ontology-grounded agents for reliable reasoning.
• Develop evaluation/benchmarking frameworks to validate AI system quality.
• Optimize latency, throughput and production cost across SAP services.
• Implement OTEL tracing and Cloud Logging dashboards for cross-service visibility.
• Collaborate with platform, data and AI teams to deliver production-ready solutions.

Skills

Distributed systems

LLMs

RAG patterns

Agentic workflows

System design for scale

Performance optimization

Observability

Tools

SAP AI Core

CAP Java

OpenTelemetry

SAP Cloud Logging

Job description

Select how often (in days) to receive an alert:

Select how often (in days) to receive an alert:

Senior Developer - Python/LLMs/RAG/AI Agents (7-12 years)

We help the world run better At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging - but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed.

What you'll bring

• You have deep experience in distributed systems and scalable application design, with strong hands-on skills in LLMs, advanced RAG patterns, and agentic workflows.
• Experience building agentic workflows on SAP AI Core and integrating LLM-based features into CAP Java applications is expected.
• Proficiency in system design for scale, resiliency, and fault tolerance is required.
• Strong experience in performance optimization, cost management, and troubleshooting complex production systems is essential.
• A solid understanding of SRE principles, observability (logs, metrics, tracing), and incident management is expected - including Open Telemetry instrumentation and SAP Cloud Logging dashboards.
• Experience designing evaluation frameworks for AI systems, validating model behavior, and applying agentic engineering patterns is critical.
• You use Claude-style tools to generate code and ideas, but you read and challenge their output - you know when the AI is making the wrong call in both code and design.
• Familiarity with multi-tenant SaaS architecture on SAP BTP (MTX, service-manager, IAS/AMS) is a strong advantage.

Four values matter at every level:

1. Learning agility (non-negotiable, and the most important value) - you rapidly pick up new models, frameworks, SAP Technologies, ontologies, and industry processes. You enjoy updating your mental model as the landscape shifts, which it will, frequently.
2. Bias for action - you move quickly from ambiguity to a working prototype and learn through execution.
3. Critical thinking - you ask the right questions, so we stay focused on the objective instead of just managing the day.
4. End-to-end ownership - you own the outcome from problem definition through build, deployment, and evaluation.

What you'll build

• You’ll independently design and architect scalable, AI-native application systems and components, including advanced RAG pipelines and multi-agent workflows.
• You’ll design and build AI agents integrated into GHRA's revenue accounting domain - including formula explanation, disposition computation assistance, and production volume analysis - using SAP AI Core and Python as primary programming language, CAP in Java will be secondary programming language.
• You’ll contribute to the design of ontology-grounded agents for the domain, encoding accounting rules, formula structures, and ownership relationships as structured knowledge that agents can reason over reliably, rather than relying on prompt-only approaches.
• Evaluation and benchmarking frameworks to measure AI system quality, reliability, and performance are things you’ll build and own. This includes domain-specific test harnesses that validate LLM outputs against known good formula results and accounting rules - and the honest memo that explains why an idea shouldn't ship.
• You’ll optimize latency, throughput, and cost efficiency across systems - including HANA Cloud query optimization and AI Core inference cost management.
• Observability and SRE practices, including monitoring, alerting, incident response, and root cause analysis, are areas you’ll implement and improve - specifically enabling OTEL tracing across the CAP microservice fleet and building Cloud Logging dashboards for cross-service visibility.
• You’ll partner with platform, data, and AI teams to design robust, production-ready solutions and improve system integration. System scalability, resilience, and maintainability are areas you’ll continuously work to strengthen.

Where you belong

If you need stable, well-defined requirements before you can start, this role will be uncomfortable. If you'd rather supervise an AI than trust it blindly, and you want to be the technical bridge between a complex accounting domain and an AI platform, keep reading. You'll take end-to-end technical ownership of critical systems and contribute to engineering excellence across the team. You'll be the technical bridge between GHRA's domain logic (royalty, production volumes, ownership allocation) and the AI platform layer - translating accounting business rules into context that agents can reason over reliably. Mentoring less-experienced engineers, guiding design and code quality, and building strong technical capabilities within the team are all part of the role. The team operates across global, cross-functional groups in a culture that values continuous improvement, operational excellence, and knowledge sharing.

Bring out your best SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best.

We win with inclusion SAP's culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone - regardless of background - feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.

SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to Recruiting Operations Team: [e-mail].

For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program , according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.

Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, ethnicity, gender (including pregnancy, childbirth, et al), sexual orientation, gender identity or expression, protected veteran status, or disability, in compliance with applicable federal, state, and local legal requirements.

Successful candidates might be required to undergo a background verification with an external vendor.

Please note that any violation of these guidelines may result in disqualification from the hiring process.

Requisition ID: 458790 | Work Area: Software-Design and Development | Expected Travel: 0 - 10% | Career Status: Professional | Employment Type: Regular Full Time | Additional Locations: #LI-Hybrid

Requisition ID: 458790

Posted Date: Aug 18, 2026

Work Area: Software-Design and Development

Employment Type: Regular Full Time

Expected Travel: 0 - 10%

Location: Bangalore, IN, 560066

Job Segment: ERP, Developer, Cloud, Compliance, Testing, Technology, Legal