Senior Python Backend Developer with AI/ML and Retrieval-Augmented Generation Expertise

Oracle India Private Limited

Bengaluru

On-site

INR 4,000,000 - 7,000,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Flexible medical
Life insurance & retirement
Volunteer programs

Job summary

Oracle India Private Limited is seeking a Senior Python Developer – Backend, AI/ML & RAG in Bengaluru. The role focuses on building scalable Python services, REST APIs, and AI-powered applications with LLMs, agent frameworks, and robust RAG pipelines.

You will ensure security, governance, and production readiness while collaborating with cross-functional teams. With 8+ years of experience, you will lead design discussions, mentor engineers, and drive engineering excellence from development to

Qualifications

  • 8+ years of software development experience.
  • Strong Python backend development.
  • Experience building production APIs (FastAPI/Flask/Django).
  • Hands-on with AI/ML apps, LLMs, and RAG pipelines.
  • Knowledge of security, privacy, and enterprise governance.

Responsibilities

  • Design, develop, and maintain Python backend services and REST APIs.
  • Build AI-powered applications with LLMs and agent frameworks.
  • Implement RAG pipelines incl. embeddings, chunking, indexing, retrieval.
  • Design secure, scalable architectures and perform code reviews.
  • Lead technical discussions and mentor engineers.
  • Support production operations and perform vulnerability remediation.

Skills

Python backend
API development
LLM integration
RAG pipelines
Security & privacy
Production delivery
Cloud & containers
Code reviews

Tools

OCI
LangChain
MCP servers/clients
Kubernetes
CI/CD
Vector databases

Job description

Senior Python Developer – Backend, AI/ML & RAG

Experience: 8+ years in software development, with strong Python backend expertise and hands-on experience delivering AI/ML applications.

About Team

Our team builds enterprise applications that combine robust backend engineering with AI-powered experiences. We develop intelligent assistants, knowledge-retrieval solutions, and workflow automation that integrate with enterprise platforms and services. We are looking for a senior developer who can translate business requirements into secure, scalable applications, guide technical design, and take ownership from development through production support.

Responsibilities
  • Design, develop, and maintain scalable Python backend services, REST APIs, and service-to-service integrations.
  • Build AI-powered applications using large language models (LLMs), agent frameworks, and machine learning capabilities.
  • Develop end-to-end Retrieval-Augmented Generation (RAG) pipelines covering document ingestion, chunking, embeddings, indexing, retrieval, and grounded response generation.
  • Implement prompt engineering, agent workflows, tool calling, and Model Context Protocol (MCP) integrations.
  • Integrate enterprise knowledge sources and applications, including ITSM platforms, Confluence, SharePoint, and enterprise APIs.
  • Evaluate AI solutions for accuracy, groundedness, hallucinations, retrieval quality, latency, and cost.
  • Build automated functional, integration, regression, performance, and AI evaluation tests.
  • Lead technical design discussions and code reviews; document architecture, APIs, and implementation decisions.
  • Troubleshoot complex application, API, integration, and production issues, and implement sustainable fixes.
  • Improve application performance, reliability, observability, and model/token efficiency.
  • Apply secure coding practices, access controls, privacy safeguards, and enterprise AI governance requirements.
  • Collaborate with product, QA, engineering, and business stakeholders to define requirements and delivery priorities.
  • Mentor engineers and improve development practices across the software development lifecycle.
  • Support production operations, dependency upgrades, vulnerability remediation, and application maintenance.
Mandatory Skills
  • Python and backend engineering: Strong hands-on Python expertise, including asynchronous programming, exception handling, testing, and maintainable application design.
  • API development: Experience building production APIs using FastAPI, Flask, Django, or a comparable framework; strong understanding of authentication, authorization, versioning, and error handling.
  • Backend architecture: Experience designing scalable services, managing concurrency, and implementing caching, background processing, retries, and resilient integrations.
  • Data management: Strong SQL and relational database skills, with experience in data modelling, query optimisation, and application data access.
  • LLM application development: Hands-on experience integrating LLMs into applications, including prompt design, structured outputs, tool calling, and failure handling.
  • RAG and retrieval: Practical experience with embeddings, vector databases or vector search, chunking strategies, metadata filtering, and retrieval optimisation.
  • ML fundamentals: Understanding of model inference, data preparation, evaluation metrics, and the distinction between model quality and application performance.
  • AI evaluation: Ability to build repeatable evaluations for retrieval relevance, response quality, groundedness, latency, and cost.
  • Security and privacy: Experience protecting sensitive data, managing secrets, enforcing access controls, and addressing prompt injection and unsafe tool execution.
  • Production delivery: Experience with cloud deployment, containers, CI/CD, logging, monitoring, and production troubleshooting.
  • Technical leadership: Ability to lead design and code reviews, mentor engineers, and communicate technical decisions clearly.
Good to Have Skills
  • Experience with OCI or other major cloud platforms.
  • Experience with agent orchestration frameworks such as LangChain, LangGraph, or equivalent tools.
  • Hands-on experience building or integrating MCP servers and clients.
  • Experience with hybrid search, reranking, query rewriting, and permission-aware enterprise retrieval.
  • Experience with Slack APIs, Jira Service Management, chatbots, and IT service-management workflows.
  • Familiarity with proactive support, ticket routing, and self-healing automation.
  • Experience with Kubernetes, infrastructure as code, and distributed tracing.
  • Experience with MLOps/LLMOps, model adaptation or fine-tuning, and model-serving platforms.
  • Familiarity with AI auditability, data residency, and enterprise governance controls.
Self Assessment Questions
  • Do I have 8+ years of software development experience , with strong hands-on expertise in Python backend development?
  • Can I independently design and build scalable APIs, backend services, and enterprise integrations?
  • Have I built AI/ML or LLM-powered applications with end-to-end RAG pipelines , including embeddings and vector search?
  • Can I test, secure, deploy, and support these applications in production while improving response quality, performance, and cost?
  • Am I comfortable owning technical delivery, leading design and code reviews, and mentoring engineers?
Benefits
  • competitive benefits that support our people with flexible medical, life insurance and retirement options.
  • We also encourage employees to give back to our communities through our volunteer programs.
Company Culture & Values

Only Oracle brings together the data, infrastructure, applications, and expertise to power everything from industry innovations to life-saving care. And with AI embedded across our products and services, we help customers turn that promise into a better future for all. Discover your potential at a company leading the way in AI and cloud solutions that impact billions of lives. True innovation starts when everyone is empowered to contribute.

We’re committed to including people with disabilities at all stages of the employment process. If you require accessibility assistance or accommodation for a disability at any point, let us know by emailing accommodation-request_mb@oracle.com or by calling 1-888-404-2494 in the United States.

Oracle is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans’ status, or any other characteristic protected by law.

Oracle will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.

Experience Level Senior Level

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Application Solution Developer
Senior Application Solution Developer

Oracle India Private Limited • Bengaluru

On-site
INR 1,500,000 - 2,100,000
AI Architect
AI Architect

Mployee.me • Bengaluru

On-site
INR 2,000,000 - 4,500,000
Software Development Snr Manager
Software Development Snr Manager

Oracle • Bengaluru

On-site
INR 4,000,000 - 7,000,000
Competitive benefits
Volunteer programs
Disability inclusion
AI Architect
AI Architect

Oracle • Bengaluru

On-site
INR 4,000,000 - 7,000,000
Senior Manager - Application Software Engineering
Senior Manager - Application Software Engineering

Oracle India Private Limited • Bengaluru

On-site
INR 3,000,000 - 5,200,000
Senior Support Engineer - Oracle AI & Big Data Platforms
Senior Support Engineer - Oracle AI & Big Data Platforms

Oracle India Private Limited • Bengaluru

On-site
INR 1,200,000 - 1,800,000
Flexible medical
Life insurance
Retirement options
Principal Software Developer
Principal Software Developer

Oracle India Private Limited • Bengaluru

On-site
INR 4,000,000 - 7,000,000
Senior Application Solution Developer (Java & Python)
Senior Application Solution Developer (Java & Python)

Oracle Corporation • India

Hybrid
INR 1,500,000 - 2,100,000
Senior Application Solution Developer (Java & Python)
Senior Application Solution Developer (Java & Python)

Inside • Bengaluru

Hybrid
INR 1,200,000 - 2,400,000
Lead Principal Software Developer
Lead Principal Software Developer

Oracle India Private Limited • Bengaluru

On-site
INR 3,000,000 - 6,000,000