Senior AI Engineer – Azure AI Foundry

Aimlroles; Bengaluru; On-site; INR 400,000 - 700,000; Full time

Job summary

Aimlroles in Bengaluru is seeking a Senior AI Engineer to design and deliver scalable Generative AI and agentic solutions on Azure AI Foundry. You will own the technical design of RAG systems and AI agents, drive quality and performance, and mentor junior engineers.

This role requires 6–8 years in software/data/AI with 2–3 years shipping Generative AI in production. You will work with clients to translate business problems into reliable AI solutions and collaborate across Azure services.

Qualifications

• 6–8 years of total software/data/AI engineering experience.
• 2–3 years delivering Generative AI solutions in production.
• Strong hands-on Azure AI Foundry experience including deployments, agents, evaluations, tracing, and content safety.
• Proven experience designing and shipping RAG systems at scale, including advanced retrieval strategies and evaluation.
• Proven experience building AI agents (tool calling, planning, multi-agent orchestration) using Azure AI Foundry and at least one agent framework.

Responsibilities

• Design and implement production-grade RAG architectures using Azure AI Foundry, Azure OpenAI, and Azure AI Search (hybrid search, semantic ranking, re-ranking, metadata filtering).
• Architect and build single- and multi-agent systems using Azure AI Foundry Agent Service, Semantic Kernel, LangGraph, or AutoGen, including tool integration, memory, and orchestration.
• Define and implement evaluation frameworks for RAG and agents (groundedness, relevance, safety, latency, cost) and drive continuous improvement.
• Optimize LLM solutions for cost, latency, and accuracy: prompt optimization, caching, model selection, fine-tuning where appropriate.
• Design and build ML models and pipelines (training, validation, deployment, monitoring) using Azure Machine Learning or equivalent.
• Implement LLMOps / MLOps practices: CI/CD, model and prompt versioning, observability, and automated testing.
• Apply responsible AI practices: content safety, PII handling, guardrails, access control, and auditability.
• Lead technical design discussions, review code and architecture, and mentor engineers on the team.
• Engage with client stakeholders to understand requirements, estimate effort, and present technical solutions.

Skills

Azure AI Foundry

RAG

AI Agents

AI/ML

Education

B.E./B.Tech./M.E./M.Tech./MCA/M.Sc in CS/DS/AI/ML

Tools

Azure OpenAI

Azure ML

Azure Functions

AKS

Job description

Senior AI Engineer – Azure AI Foundry

Experience

6 – 8 years

Level

Senior

Location

Delhi / Mumbai / Bangalore (India)

Employment Type

Full-time

Primary Skills

Azure AI Foundry, RAG, AI Agents, AI / ML

Role Summary

We are seeking a Senior AI Engineer to design and deliver scalable Generative AI and agentic solutions on Azure AI Foundry. You will own the technical design of RAG systems and AI agents, drive quality and performance, mentor junior engineers, and work directly with client stakeholders to translate business problems into reliable AI solutions.

Key Responsibilities

• Design and implement production-grade RAG architectures using Azure AI Foundry, Azure OpenAI, and Azure AI Search (hybrid search, semantic ranking, re-ranking, metadata filtering).

• Architect and build single- and multi-agent systems using Azure AI Foundry Agent Service, Semantic Kernel, LangGraph, or AutoGen, including tool integration, memory, and orchestration.

• Define and implement evaluation frameworks for RAG and agents (groundedness, relevance, safety, latency, cost) and drive continuous improvement.

• Optimize LLM solutions for cost, latency, and accuracy: prompt optimization, caching, model selection, fine-tuning where appropriate.

• Design and build ML models and pipelines (training, validation, deployment, monitoring) using Azure Machine Learning or equivalent.

• Implement LLMOps / MLOps practices: CI/CD, model and prompt versioning, observability, and automated testing.

• Apply responsible AI practices: content safety, PII handling, guardrails, access control, and auditability.

• Lead technical design discussions, review code and architecture, and mentor engineers on the team.

• Engage with client stakeholders to understand requirements, estimate effort, and present technical solutions.

Required Skills & Experience

• 6 – 8 years of total experience in software / data / AI engineering, with at least 2 – 3 years delivering Generative AI solutions in production.

• Strong, hands-on expertise in Azure AI Foundry, including model deployments, agents, evaluations, tracing, and content safety.

• Proven experience designing and shipping RAG systems at scale, including advanced retrieval strategies and evaluation.

• Proven experience building AI agents (tool calling, planning, multi-agent orchestration) using Azure AI Foundry and at least one agent framework.

• Solid AI/ML background: model development, hyperparameter tuning, evaluation, deployment; experience with PyTorch / TensorFlow / scikit-learn; NLP / transformer fundamentals.

• Expert-level Python; experience building scalable APIs and microservices.

• Strong Azure experience: Azure OpenAI, AI Search, Azure ML, Functions, Container Apps / AKS, Cosmos DB, Key Vault, API Management, Application Insights.

• Hands-on experience with MLOps / LLMOps tooling and CI/CD (Azure DevOps or GitHub Actions).

• Experience mentoring junior engineers and leading small delivery teams.

.

Good to Have

• Azure certifications (AI-102, DP-100, AZ-305).

• Experience with fine-tuning (LoRA / PEFT), model distillation, or small language models.

• Experience with Model Context Protocol (MCP) and enterprise tool integrations.

• Experience with Microsoft Fabric, Databricks, or Synapse for data engineering.

• Experience with Infrastructure as Code (Bicep / Terraform).

Soft Skills

• Strong stakeholder communication and client-facing presentation skills.

• Ability to break down ambiguous problems and drive them to delivery.

• Mentoring and team-building mindset.

Education

B.E. / B.Tech / M.E. / M.Tech / MCA / M.Sc in Computer Science, Data Science, AI/ML, or a related field.

.