Senior GenAI & Agentic AI Engineer

Persistent Systems; Pune District; Remote; INR 4,500,000 - 7,000,000; Full time

Benefits offered by this job

Insurance coverage

Hybrid work

Flexible hours

Long Service awards

Education sponsorship

Project parties

Mediclaim coverage

Job summary

Persistent is seeking a Senior GenAI & Agentic AI Engineer to design, build, and deploy enterprise-grade AI solutions powered by LLMs, RAG, and Agentic AI frameworks. You will lead end-to-end RAG pipelines, MCP connectors, and autonomous AI workflows across on-prem and cloud environments.

The role requires 6–10 years of software/AI engineering, strong Python and C++ skills, and hands-on experience with LLMs, RAG architectures, and vector databases. Join a culture focused on innovation and growth.

Qualifications

• 6 to 10 years of software engineering or AI engineering experience.
• Minimum 3+ years building Generative AI/LLM-based solutions.
• Strong Python programming skills and SWE practices.
• Good understanding of C++ development and integrations.
• Experience building enterprise-scale AI apps and intelligent assistants.
• Deep knowledge of LLMs and enterprise AI patterns.
• Experience implementing end-to-end RAG architectures.
• Familiarity with Pinecone and semantic search.
• Experience with MCP integrations and AI tool-calling frameworks.
• Strong prompt engineering and LLM optimization skills.

Responsibilities

• Lead design and development of enterprise AI apps powered by LLMs and GenAI technologies.
• Build end-to-end Retrieval-Augmented Generation (RAG) pipelines including ingestion, embedding, indexing, retrieval and response generation.
• Design optimized retrieval strategies with semantic search and contextual ranking.
• Develop MCP connectors exposing enterprise apps and APIs as agent-callable tools.
• Implement Agentic AI workflows with planning, reasoning, decision-making, and autonomous execution.
• Contribute to AI orchestration frameworks integrating RAG, MCP tools, and workflow engines.
• Build scalable AI services and backend systems for production-grade AI solutions.
• Collaborate with architects, data engineers, and stakeholders to translate requirements into implementations.
• Drive prompt engineering, model tuning, evaluation, and AI optimization initiatives.
• Create proof-of-concepts, accelerators, and reusable AI components.
• Ensure security, governance, observability and monitoring in AI apps.
• Support deployment of AI workloads in containerized and cloud-native environments.
• Lead technical reviews and establish AI engineering best practices.
• Mentor engineering teams on AI and data engineering initiatives.
• Stay updated with advancements in LLMs, Agentic AI, MCP, and RAG architectures.

Skills

Python

Generative AI

LLMs

RAG architectures

Agentic AI

LangChain / LlamaIndex

Vector databases

Embeddings & semantic search

MCP integrations

C++

Tools

Pinecone

LlamaIndex

LangChain

Job description

We are seeking a highly skilled Senior GenAI & Agentic AI Engineer to design, build, and deploy enterprise-grade AI solutions powered by Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and Agentic AI frameworks. The ideal candidate will possess strong expertise in Python, AI orchestration frameworks, vector databases, and enterprise AI integration patterns. You will play a key role in developing intelligent applications, building autonomous AI agents, and implementing scalable AI architectures that drive business innovation and operational excellence.

• Role: Senior GenAI & Agentic AI Engineer
• Location: All Persistent Locations
• Experience: 6 to 10 Years
• Job Type: Full-Time Employment

What You'll Do:

• Lead the design and development of enterprise AI applications powered by LLMs and Generative AI technologies.
• Build and implement end-to-end Retrieval-Augmented Generation (RAG) pipelines, including ingestion, chunking, embedding, indexing, retrieval, and response generation.
• Design and optimize retrieval strategies using semantic search, contextual awareness, and relevance ranking techniques.
• Develop and maintain MCP (Model Context Protocol) connectors that expose enterprise applications and APIs as agent-callable tools.
• Implement Agentic AI workflows capable of planning, reasoning, decision-making, and autonomous task execution.
• Contribute to AI orchestration frameworks that integrate RAG systems, MCP tools, workflow engines, and enterprise platforms.
• Develop scalable AI services and backend systems supporting production-grade AI solutions.
• Collaborate with architects, AI engineers, data engineers, and business stakeholders to convert business requirements into technical implementations.
• Drive prompt engineering, model tuning, evaluation, and AI optimization initiatives.
• Build proof-of-concepts, accelerators, and reusable AI components.
• Ensure security, governance, compliance, observability, and monitoring are integrated into AI applications.
• Support deployment and operation of AI workloads in containerized and cloud-native environments.
• Conduct technical reviews and establish AI engineering best practices.
• Mentor engineering teams and provide technical leadership on AI and data engineering initiatives.
• Stay updated with advancements in LLMs, Agentic AI, MCP, RAG architectures, and enterprise AI technologies.

Expertise You'll Bring:

• 6 to 10 years of software engineering, AI engineering, or application development experience.
• Minimum 3+ years of hands-on experience developing Generative AI and LLM-based solutions.
• Strong expertise in Python programming and software engineering practices.
• Good understanding of C++ development and integrations.
• Hands-on experience building enterprise-scale AI applications and intelligent assistants.
• Strong understanding of Large Language Models (LLMs) and enterprise AI implementation patterns.
• Experience implementing end-to-end Retrieval-Augmented Generation (RAG) architectures.
• Expertise with LlamaIndex, LangChain, or similar AI orchestration frameworks.
• Strong understanding of Agentic AI workflows and multi-agent architectures.
• Experience with vector databases such as Pinecone and semantic search implementations.
• Knowledge of embeddings, retrieval mechanisms, reranking strategies, and contextual search techniques.
• Experience implementing MCP (Model Context Protocol) integrations and AI tool-calling frameworks.
• Familiarity with FastMCP and modern agent orchestration approaches.
• Strong experience with prompt engineering and LLM optimization techniques.
• Experience integrating AI solutions with enterprise systems, APIs, and business applications.
• Knowledge of software design patterns, scalability principles, and distributed architectures.
• Strong troubleshooting, debugging, and performance optimization skills.
• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."