Senior AI Data Engineer

EXL; Gurugram District; On-site; INR 2,500,000 - 4,500,000; Full time

Job summary

EXL in Gurugram, India is seeking an experienced GenAI/LLM engineer to design and deploy end-to-end AI solutions in a production environment, focusing on agentic architectures, RAG pipelines, and integration with enterprise data systems.

The role emphasizes hands-on development in Python, LangChain, and cloud data platforms, with collaboration across Data Engineering and MLOps to scale AI capabilities while ensuring guardrails and responsible AI practices.

Qualifications

• Hands-on experience with GenAI/LLM application development in production
• Strong Python/PySpark development and API integration
• Experience with RAG pipelines, embeddings, retrieval, and orchestration
• Familiarity with LangChain, LangGraph, or similar frameworks
• Understanding of LLM limitations, evaluation, and optimization strategies

Responsibilities

• Design and develop LLM-powered applications using agentic patterns for business use cases
• Build end-to-end RAG pipelines including ingestion, embeddings, retrieval, orchestration and response synthesis
• Implement prompt engineering and orchestration techniques
• Develop production-grade APIs and services (FastAPI/Flask/Streamlit) for GenAI applications
• Integrate LLM solutions with enterprise systems and data platforms
• Apply guardrails and evaluation frameworks to improve response quality and reduce hallucinations
• Collaborate with Data Engineering and MLOps teams for data pipelines, deployment, monitoring, and scaling
• Contribute to reusable components, documentation, and engineering best practices

Skills

Python

Pyspark

API development

LangChain

Agent orchestration

LLM/GenAI

SQL

Cloud platforms

CI/CD

Data engineering

Education

B.Tech / M.Tech in Computer Science or related field

Tools

Azure Databricks

Snowflake

Azure/AWS/GCP

Docker

Kubernetes

FastAPI

Job description

• Design and develop LLM-powered applications using agentic patterns (single/multi-agent) for business use cases
• Build and optimise end-to-end RAG pipelines (ingestion, embeddings, retrieval, orchestration, response synthesis)
• Implement prompt engineering and orchestration techniques (prompt chaining, tool/function calling, structured outputs)
• Develop production-grade APIs and services (FastAPI/Flask/Streamlit) for GenAI applications
• Integrate LLM solutions with enterprise systems, data platforms, and workflows
• Apply guardrails and evaluation frameworks to improve response quality, reduce hallucinations, and ensure responsible AI usage
• Collaborate with Data Engineering and MLOps teams for data pipelines, deployment, monitoring, and scaling
• Contribute to reusable components, documentation, and engineering best practices

Key Responsibilities

• Design and develop LLM-powered applications using agentic patterns (single/multi-agent) for business use cases
• Build and optimise end-to-end RAG pipelines (ingestion, embeddings, retrieval, orchestration, response synthesis)
• Implement prompt engineering and orchestration techniques (prompt chaining, tool/function calling, structured outputs)
• Develop production-grade APIs and services (FastAPI/Flask/Streamlit) for GenAI applications
• Integrate LLM solutions with enterprise systems, data platforms, and workflows
• Apply guardrails and evaluation frameworks to improve response quality, reduce hallucinations, and ensure responsible AI usage
• Collaborate with Data Engineering and MLOps teams for data pipelines, deployment, monitoring, and scaling
• Contribute to reusable components, documentation, and engineering best practices

Experience & Core Requirements (Must-Have)

Overall Experience

• 6–9 years total experience
• 1–3+ years in hands-on GenAI / LLM application development (production use cases)

LLM / GenAI & Agentic Engineering

• Strong hands-on experience with: LLMs (Claude, OpenAI, etc.)
• RAG pipelines and retrieval optimisation
• GPT + Agentic AI implementation experience
• Experience with: LangChain, LangGraph, or similar frameworks
• Agent orchestration and tool-calling architectures
• Deep understanding of: LLM limitations, evaluation, and optimisation strategies

Core Engineering

• Strong Python/Pyspark engineering expertise (production-grade development) with proven API integration experience
• Deep data analysis experience and handling large volume of data
• Fabric/Azure Databricks/Snowflake data engineering integration skills
• Good exposure to: Cloud platforms (Azure/AWS/GCP)
• SQL
• Containers, CI/CD, monitoring

Data / AI Foundations (Mandatory)

Prior Experience In One Or More

• Data Engineering (ETL/ELT, pipelines, orchestration)
• Data Science / ML lifecycle (especially NLP)
• Analytics engineering / data products

Good-to-Have / Preferred

• Experience with fine-tuning techniques (LoRA, PEFT) or prompt tuning strategies
• Experience with enterprise GenAI security & privacy practices (data masking, access control, compliance)
• Familiarity with Azure AI ecosystem (Azure OpenAI, Azure AI Search, Fabric, etc.)

Exposure to agentic coding tools (e.g., Claude Code or similar environments)