AI/ML Engineer

InOpTra Digital; Bengaluru; On-site; INR 2,600,000 - 3,800,000; Full time

Benefits offered by this job

Remote / Hybrid work options

Learning & innovation focus

Job summary

InOpTra Digital seeks an experienced AI/ML Engineer to design, develop, and deploy enterprise-grade AI solutions with a focus on conversational AI and RAG architectures. You will build end-to-end RAG pipelines, integrate LLMs with retrieval systems on Azure, and ensure scalable, secure, and cost-efficient AI deployments.

You will collaborate with data engineers, product managers, and domain experts to translate business requirements into high-quality AI features, while advancing MLOps practices

Qualifications

• 8+ years of software engineering / development experience.
• 4+ years on Microsoft Azure cloud platform (Azure PaaS preferred).
• 2+ years dedicated AI/ML engineering experience delivering production AI/ML solutions.
• Strong hands-on experience designing and implementing chatbots / conversational agents using RAG architecture.

Responsibilities

• Design, build, and deploy enterprise-grade chatbots with RAG architecture.
• Develop end-to-end RAG pipelines including ingestion, chunking, embeddings, vector storage, retrieval, and generation.
• Integrate LLMs with retrieval systems using Azure OpenAI or other providers.
• Architect scalable AI solutions on Azure using services such as Azure OpenAI, Azure AI Search, Azure ML, Prompt Flow, and Cosmos DB / Azure SQL.
• Build production MLOps pipelines using Azure DevOps, MLflow or equivalent tools for versioning, CI/CD, monitoring, and retraining.
• Collaborate with data engineers, product managers, and domain experts to translate requirements into AI features.
• Optimize AI systems for performance, cost, latency, and reliability in cloud environments.
• Implement evaluation frameworks, A/B testing, and continuous improvement for conversational accuracy.
• Ensure secure, compliant, and ethical AI implementations (guardrails, PII handling, content filtering).

Skills

Software engineering

AI/ML engineering

Python

Chatbot design

Tools

Azure AI Search

FAISS

Pinecone

Weaviate

LangChain

LlamaIndex

Semantic Kernel

Haystack

Docker

Kubernetes

MLflow

Azure Machine Learning

Bot Framework

Job description

We are seeking a skilled AI/ML Engineer to join our team and contribute to the design, development, and deployment of intelligent AI solutions, with a strong focus on conversational AI and Retrieval-Augmented Generation (RAG) architectures. This role is ideal for an experienced engineer who has successfully delivered production-grade AI applications, particularly chatbots and knowledge-driven systems, while leveraging Microsoft Azure as the primary cloud platform. Location: [Remote / Hybrid / Bengaluru / Specify as per company policy]Experience Level: Mid-Senior (8+ years total IT/engineering experience)

Key Responsibilities

• Design, build, and deploy enterprise-grade chatbots and conversational AI applications using RAG architecture to enable accurate, context-aware, and hallucination-reduced responses
• Develop end-to-end RAG pipelines including document ingestion, chunking, embedding generation, vector storage, hybrid/semantic retrieval, re-ranking, and generation augmentation
• Integrate Large Language Models (LLMs) (via Azure OpenAI or other providers) with retrieval systems and implement advanced techniques such as query rewriting, contextual compression, and evaluation metrics
• Architect and implement scalable AI/ML solutions on Microsoft Azure, leveraging services such as Azure OpenAI, Azure AI Search (for vector/hybrid search), Azure Machine Learning, Azure AI Services, Prompt Flow, and Azure Cosmos DB / Azure SQL
• Build and maintain production MLOps pipelines using Azure DevOps, MLflow, or equivalent tools for model versioning, CI/CD, monitoring, and automated retraining
• Collaborate with data engineers, product managers, and domain experts to translate business requirements into high-quality AI features
• Optimize AI systems for performance, cost, latency, and reliability in cloud environments
• Implement evaluation frameworks, A/B testing, and continuous improvement for conversational accuracy and user satisfaction
• Ensure secure, compliant, and ethical AI implementations (guardrails, PII handling, content filtering)

Required Qualifications & Experience

• 8+ years of overall software engineering / development experience
• 4+ years of hands-on experience with Microsoft Azure cloud platform (Azure PaaS services preferred)
• 2+ years of dedicated AI/ML engineering experience, with proven delivery of production AI/ML solutions
• Strong hands-on experience designing and implementing chatbots / conversational agents using RAG architecture

Practical Expertise In Building RAG Systems, Including

• Vector databases / vector search (Azure AI Search, FAISS, Pinecone, Weaviate, etc.)
• Embedding models and semantic search techniques
• Orchestration frameworks such as LangChain, LlamaIndex, Semantic Kernel, or Haystack
• Proficiency in Python (production-grade coding)
• Experience working with LLMs — prompt engineering, fine-tuning (nice to have), chaining, tool/function calling
• Familiarity with Azure AI ecosystem: Azure OpenAI, Azure Machine Learning, Azure Cognitive Services / AI Search, Bot Framework (advantage)
• Good understanding of MLOps practices and deployment patterns (Docker, Kubernetes, CI/CD)

Preferred / Nice-to-Have Skills

• Azure certifications (e.g., Azure AI Engineer Associate, Azure Data Scientist Associate)
• Experience with agentic AI / multi-agent systems
• Knowledge of classical ML + deep learning frameworks (PyTorch / TensorFlow)
• Exposure to evaluation tools (RAGAS, DeepEval) and observability for GenAI applications
• Previous work in enterprise environments (security, scalability, cost optimization)

What We Offer

• Opportunity to work on cutting-edge Generative AI and RAG-powered solutions
• Collaborative environment with focus on innovation and learning