RAG + Agentic AI Engineer (India) (Remote)

Codvo Private Limited; India; Remote; INR 1,500,000 - 2,500,000; Full time

Benefits offered by this job

Work on cutting-edge technology

Ownership over enterprise-grade architectures

Fast growth environment

Job summary

A technology company in India is seeking a highly skilled RAG + LLM-based Agentic AI Engineer. The ideal candidate will build production-grade retrieval systems and enterprise-ready AI applications, working with document pipelines and multi-agent workflows. You will influence innovative data solutions in a fast growth environment that encourages experimentation and learning.

Qualifications

• Extensive experience in RAG and agentic AI engineering.
• Solid understanding of vector search systems and LLM operations.
• Familiarity with security and governance in AI applications.

Responsibilities

• Build end-to-end RAG pipelines and implement various workflows.
• Develop and optimize vector search systems for enterprise data.
• Collaborate with architects to translate use cases into AI systems.

Skills

Smart/component-aware chunking

Hybrid retrieval (BM25 + dense)

Multi-agent orchestration

Python

FastAPI

Document parsing

Tools

Docker

CI/CD

Qdrant

Weaviate

OpenSearch

Job description

Job Description — RAG + Agentic AI Engineer

About Us

At Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges with creativity and cutting‑edge technology.

About the Role

We are looking for a highly skilled RAG + LLM‑based Agentic AI Engineer to build production‑grade retrieval systems, multi‑agent workflows, and enterprise‑ready AI applications. You will work across document pipelines, model orchestration, tool‑driven agents, and governed AI systems that power Codvo’s next‑generation products

Key Responsibilities

• Build end‑to‑end RAG pipelines: smart chunking, hybrid retrieval, reranking, query rewriting.
• Implement LangGraph‑based agentic workflows with tools, planning, and self‑healing behaviors.
• Develop and optimise vector search systems (Qdrant/Weaviate/OpenSearch).
• Design multi‑tenant, ontology‑driven knowledge layers for enterprise data.
• Implement guardrails, hallucination reduction, and automated evals.
• Build and maintain document ingestion pipelines (PDF, DOCX, OCR, images).
• Architect and deploy FastAPI‑based AI microservices with caching and async execution.
• Integrate LLM systems with enterprise apps (SharePoint, CRM, databases, MCP tools).
• Ensure security, PII safety, auditability, and governance requirements are met.
• Collaborate with solution architects and domain SMEs to translate use cases into working AI systems.

Core Skills & Competencies

RAG Engineering

• Smart/component‑aware chunking
• Hybrid retrieval (BM25 + dense)
• Reranking
• Graph‑RAG basics
• Query rewriting & multi‑hop retrieval

Agentic AI

• LangGraph
• MCP tools
• Multi‑agent orchestration
• Tool‑calling workflows

Vector & Search

• Qdrant or Weaviate
• OpenSearch/Elasticsearch
• HNSW tuning

LLM Ops

• Prompt engineering
• Hallucination control
• RAG/agent eval frameworks
• Synthetic data generation

Backend & Infra

• Python, FastAPI
• Async programming
• Docker, CI/CD
• Cloud basics

Data Engineering

• Document parsing
• ETL pipelines
• Caching, batching, streaming

Security & Governance

• PII handling
• Access control
• Audit trails

Nice‑to‑Have

• Experience with Haystack, LlamaIndex, or RAG frameworks
• Fine‑tuning retrievers or small LLMs
• Ontology modeling
• Enterprise search deployments
• Agents in customer support, ops, legal, engineering

What You’ll Get

• Work on cutting‑edge agentic AI systems at production scale
• Ownership over enterprise‑grade architectures
• Fast growth environment
• Influence Codvo’s platform and accelerators