Senior AI Developer – Agentic AI / Conversational AI

Ekfrazo Technologies Private Limited; Bengaluru; Remote; INR 1,800,000 - 2,400,000; Full time

Job summary

Ekfrazo Technologies Private Limited is seeking a hands-on Senior AI Developer to design, build, and deploy scalable Conversational AI and Agentic AI solutions. You will architect and implement AI agents, orchestrate LLM-driven workflows, integrate enterprise systems, and ensure observability, security, and reliability in production.

You will collaborate with architecture, frontend, backend, cloud, SRE, QA, and product teams, contribute to technical design, code reviews, and production support,

Qualifications

• 7-10+ years of hands-on AI development experience.
• Strong Python backend/API development with FastAPI.
• Hands-on experience building LLM-based Conversational AI and agent orchestration.
• Proficiency with LangGraph, LangChain, or similar frameworks.
• Experience with Azure OpenAI / Azure AI Foundry.
• Understanding of prompt engineering, structured outputs, and LLM observability.
• Familiarity with security, privacy, and auditable AI practices.
• Excellent debugging and communication skills.

Responsibilities

• Design and develop Conversational AI and Agentic AI applications using LLMs.
• Build and maintain AI agents, workflows, tool calling, and routing.
• Develop backend services and APIs to integrate AI with enterprise systems.
• Implement agent orchestration using LangGraph, LangChain, or similar.
• Develop tools via REST APIs, function calls, MCP, or structured contracts.
• Implement Retrieval-Augmented Generation and knowledge retrieval.
• Establish LLM observability including tracing, latency, and costs.
• Contribute to architecture discussions and production support.

Skills

Python

FastAPI

LangGraph

LangChain

Azure OpenAI

Azure AI Foundry

REST APIs

Prompt engineering

LLM observability

RAG / embeddings

Vector search

Security & privacy

Debugging & communication

Education

Bachelor’s degree in CS/Engineering

Tools

LangGraph

LangChain

Azure Monitor / Application Insights

Docker / Containers

Job description

Role: Senior AI Developer – Agentic AI / Conversational AI

Experience: 7-10+ years overall, with relevant hands-on experience in developing AI/LLM-based applications.

Work Timing: 1:30 – 10:30 PM IST

Location: Remote

We are looking for a hands-on Senior AI Developer to design, develop, and implement scalable, production-ready Conversational AI and Agentic AI solutions.

The role involves building AI agents, orchestrating LLM-driven workflows, integrating enterprise systems, and implementing observability, security, and reliability practices. The candidate should be comfortable contributing to solution architecture while taking ownership of development and technical implementation.

Key Responsibilities

• Design and develop Conversational AI and Agentic AI applications using LLMs and orchestration frameworks.
• Build and maintain AI agents, workflows, intent routing, state management, tool calling, and fallback mechanisms.
• Develop backend services and APIs to integrate AI capabilities with enterprise systems.
• Implement agent orchestration using LangGraph, LangChain, or similar frameworks.
• Develop and integrate tools using REST APIs, function calling, MCP, or structured contracts.
• Implement Retrieval-Augmented Generation (RAG) and knowledge retrieval capabilities where applicable.
• Implement LLM observability covering tracing, latency, token usage, cost, errors, and response quality.
• Develop evaluation and testing mechanisms to improve AI accuracy, reliability, and consistency.
• Ensure security, privacy, auditability, and responsible AI practices.
• Collaborate with architecture, frontend, backend, cloud, SRE, QA, and product teams.
• Participate in technical design discussions, code reviews, troubleshooting, and production support.

Required Skills

• Strong hands-on programming experience in Python, including backend/API development using FastAPI or similar frameworks.
• Hands-on experience developing LLM-based or Conversational AI applications.
• Practical experience with LangGraph, LangChain, or equivalent agent orchestration frameworks.
• Good understanding of Agentic AI concepts, including state management, intent routing, tool calling, workflow orchestration, and error handling.
• Experience with Azure OpenAI, Azure AI Foundry (Microsoft Foundry), or equivalent cloud-hosted LLM platforms.
• Experience integrating LLM applications with REST APIs, backend services, databases, and enterprise applications.
• Understanding of prompt engineering, function calling, structured outputs, and LLM response handling.
• Experience implementing or working with LLM observability, monitoring, logging, and tracing.
• Understanding of RAG, embeddings, vector search, and knowledge retrieval patterns.
• Familiarity with authentication, authorization, security, and data privacy in AI applications.
• Strong debugging, problem-solving, and communication skills.

Nice to Have

• Experience implementing MCP servers/clients or MCP-based integrations.
• Experience with Azure AI Search and vector databases.
• Experience with LangSmith, Langfuse, OpenTelemetry, Azure Monitor, or Application Insights.
• Experience with LLM evaluation frameworks and automated quality testing.
• Experience deploying AI applications on Azure using Docker, containers, or managed cloud services.
• Exposure to CI/CD, GitHub Actions, and production release processes.
• Experience in CRM, contact centers, customer-facing applications, or enterprise portals.
• Experience in deterministic or controlled AI workflows requiring predictable business outcomes.