Senior Python AI Engineer

Persistent Systems Limited; Hyderabad; Hybrid; INR 4,000,000 - 7,000,000; Full time

Benefits offered by this job

Hybrid work & flexible hours

Education sponsorship & certifications

Team events & engagement programs

Insurance: group term life, personal/0

Long Service awards

Job summary

Persistent Systems Limited is seeking a Senior Python AI Engineer in Hyderabad to design, develop, and deploy enterprise-grade GenAI and LLM-based solutions. You will build RAG systems, agent workflows, and scalable APIs using FastAPI, collaborating with product teams and data scientists.

Ideal candidates have 6–8 years of software experience, deep Python expertise, and hands-on GenAI experience with LangChain/LangGraph, vector databases, and diverse LLMs.

Qualifications

• 6-8 years of software development experience with Python.
• Strong hands-on experience in Generative AI application development.
• Expertise in Prompt Engineering and optimization techniques.
• Strong development experience with LangChain and LangGraph.
• Experience building enterprise-grade RAG solutions.
• Hands-on experience with LLMs and AI Agent architectures.
• Experience integrating OpenAI, Azure OpenAI, Claude, Gemini or similar models.
• Knowledge of vector databases, embeddings, semantic search, and retrieval systems.
• Experience designing REST APIs using FastAPI.
• Understanding of microservices architecture and scalable backend development.
• Experience with structured and unstructured data sources for AI apps.
• Knowledge of model evaluation, prompt testing, and AI performance optimization.
• Familiarity with cloud environments such as Azure, AWS, or GCP.
• Strong analytical, problem-solving, and debugging skills.
• Experience working in Agile/Scrum environments.
• Excellent communication and collaboration skills.

Responsibilities

• Design, develop, and deploy AI-powered applications using Python and modern GenAI frameworks.
• Build and implement Retrieval-Augmented Generation (RAG) solutions using enterprise knowledge repositories and vector stores.
• Develop agentic AI workflows and multi-agent systems using LangChain and LangGraph.
• Design, optimize, and evaluate prompts for LLM-based applications.
• Integrate enterprise applications with LLM providers such as OpenAI, Azure OpenAI, Claude, Gemini, and others.
• Build scalable APIs and microservices using FastAPI and REST-based architectures.
• Develop conversational AI assistants, copilots, chatbots, and intelligent automation solutions.
• Work with embeddings, vector stores, semantic search, and retrieval pipelines.
• Implement AI governance, security, and responsible AI best practices.
• Optimize model performance, latency, cost, and production reliability.
• Collaborate with product owners, architects, data scientists, and engineering teams.
• Conduct testing, debugging, monitoring, and troubleshooting of AI applications.
• Participate in architecture reviews, code reviews, and technical design discussions.
• Create technical documentation, implementation guides, and deployment procedures.
• Stay updated with GenAI advancements and best practices.

Skills

Python

Generative AI

LangChain

Prompt engineering

RAG

LLMs & AI agents

OpenAI/Azure/OpenAI/Claude/Gemini

Vector databases & embeddings

REST APIs with FastAPI

Microservices architecture

Structured & unstructured data

Model evaluation & prompt testing

Cloud platforms (Azure/AWS/GCP)

Agile/Scrum

Communication & collaboration

Tools

FastAPI

OpenAI API

Azure OpenAI

LangChain

Job description

We are an AI-led, platform-driven Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what's next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many industry-leading organizations across the world, including 20 Fortune 50 companies and 4 of the 5 top banks in both the US and India, and numerous innovators across the healthcare ecosystem.

We are seeking a highly skilled Senior Python AI Engineer with expertise in Generative AI, Large Language Models (LLMs), Prompt Engineering, LangChain, LangGraph, and Retrieval-Augmented Generation (RAG). The ideal candidate will be responsible for designing, developing, and deploying enterprise-grade AI-powered applications, intelligent agents, and scalable GenAI solutions.

• Role: Senior Python AI Engineer - Generative AI & LLM Solutions
• Experience: 6 to 8 Years
• Job Type: Full-Time Employment

What You'll Do:

• Design, develop, and deploy AI-powered applications using Python and modern Generative AI frameworks.
• Build and implement Retrieval-Augmented Generation (RAG) solutions utilizing enterprise knowledge repositories and vector databases.
• Develop Agentic AI workflows and multi-agent systems using LangChain and LangGraph.
• Design, optimize, and evaluate prompts for Large Language Model-based applications.
• Integrate enterprise applications with LLM providers such as OpenAI, Azure OpenAI, Claude, Gemini, and other AI platforms.
• Build scalable APIs and microservices using FastAPI and REST-based architectures.
• Develop conversational AI assistants, copilots, chatbots, and intelligent automation solutions.
• Work with embedding models, vector stores, semantic search, and retrieval pipelines.
• Implement AI governance, security, and responsible AI best practices.
• Optimize model performance, latency, cost, and response quality for production environments.
• Collaborate with product owners, architects, data scientists, and engineering teams to deliver AI-driven solutions.
• Conduct testing, debugging, monitoring, and troubleshooting of AI applications.
• Participate in architecture reviews, code reviews, and technical design discussions.
• Create technical documentation, implementation guides, and deployment procedures.
• Stay updated with emerging advancements in Generative AI, LLMs, agent frameworks, and AI engineering best practices.

Expertise You'll Bring:

• 6-8 years of software development experience with strong proficiency in Python.
• Strong hands-on experience in Generative AI application development.
• Expertise in Prompt Engineering and prompt optimization techniques.
• Strong development experience with LangChain and LangGraph.
• Experience building enterprise-grade RAG (Retrieval-Augmented Generation) solutions.
• Hands-on experience with Large Language Models (LLMs) and AI Agent architectures.
• Experience integrating OpenAI, Azure OpenAI, Claude, Gemini, or similar models.
• Strong knowledge of vector databases, embeddings, semantic search, and retrieval systems.
• Experience designing and developing REST APIs using FastAPI.
• Understanding of microservices architecture and scalable backend development.
• Experience working with structured and unstructured data sources for AI applications.
• Knowledge of model evaluation, prompt testing, and AI performance optimization.
• Familiarity with cloud environments such as Azure, AWS, or Google Cloud Platform.
• Strong analytical, problem-solving, and debugging skills.
• Experience working in Agile/Scrum environments.
• Excellent communication and collaboration skills.
• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

\"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.\"