AI and Agent Engineer - Senior Associate

Weaver India; Bengaluru; On-site; INR 4,000,000 - 6,500,000; Full time

Job summary

Weaver India seeks a Senior AI and Agent Engineer to develop, integrate, test, deploy, and monitor AI-enabled applications and agents across the Microsoft ecosystem. You will drive intelligence, orchestration, actions, integrations, and behavioral quality of AI solutions.

Responsibilities include building Copilot Studio agents, orchestrating workflows, and integrating with Azure OpenAI, Graph, SharePoint, Teams, and Dataverse.

Qualifications

• Strong Python development experience in production systems.
• Proficiency with TypeScript/JavaScript in web apps.
• Experience with REST APIs, OAuth, OpenAPI, and webhooks.
• Familiar with Copilot Studio, Azure AI tools, and Power Platform.
• Knowledge of Microsoft Graph, Dataverse, SharePoint, and Teams integrations.
• Experience with retrieval-augmented generation, vector/semantic search, and structured generation.
• Expertise in agent orchestration, state management, and human-in-the-loop controls.
• Experience with automated testing, Git, CI/CD, and production troubleshooting.
• Ability to instrument solutions with monitoring and performance diagnostics.
• Understanding of prompt injection and AI-specific failure modes.

Responsibilities

• Develop, integrate, test, deploy, and monitor AI-enabled applications and agents across the Microsoft ecosystem.
• Build Copilot Studio agents, topics, actions, triggers, workflows, and generative orchestration.
• Develop AI apps using Azure OpenAI, Azure Foundry, and Azure Cognitive services.
• Implement retrieval-augmented generation, structured outputs, tool use, and multi-step orchestration.
• Create custom APIs, Azure Functions, connectors, and supporting services.
• Integrate AI solutions with Graph, SharePoint, Teams, Dataverse, and Power Platform.
• Design system prompts, grounding logic, response structures, and escalation rules.
• Automate tests for groundedness, relevance, citation quality, and task completion.
• Instrument telemetry, review performance, and optimize token consumption and latency.
• Develop reusable agent templates and error-handling patterns.

Skills

Python development

TypeScript/JavaScript

REST APIs/OAuth/OpenAPI

Azure AI tools

Microsoft Graph integration

RAG & vector search

Agent orchestration

CI/CD & testing

Application Insights/Monitoring

AI safety & failure modes

Tools

Copilot Studio

Power Automate

Azure AI Foundry

Azure OpenAI

Azure AI Search

Microsoft Graph

Dataverse

SharePoint

Teams integration

Semantic Kernel

CI/CD tooling

Job description

The Senior AI and Agent Engineer will develop, integrate, test, deploy, and monitor AI-enabled applications and agents across the Microsoft ecosystem. The role is responsible for the intelligence, orchestration, actions, integrations, and behavioral quality of AI solutions.

Primary Responsibilities

AI and agent development

• Build and configure Copilot Studio agents, topics, actions, triggers, workflows, and generative orchestration.
• Develop AI applications using Azure AI Foundry, Azure OpenAI, Azure AI Search, and supporting Azure services.
• Implement retrieval-augmented generation, structured outputs, tool use, multistep orchestration, and human approval patterns.
• Develop custom APIs, Azure Functions, connectors, and supporting application services.
• Integrate AI solutions with Microsoft Graph, SharePoint, Teams, Dataverse, Power Platform, and approved enterprise systems.

Prompt, context, and behavior engineering

• Develop system instructions, prompts, grounding logic, response structures, fallback behavior, and escalation rules.
• Implement model selection and routing based on accuracy, risk, latency, and consumption requirements.
• Design agent behavior that distinguishes between answering, recommending, requesting clarification, escalating, and taking action.
• Maintain version control for prompts, instructions, tools, actions, and model configurations.

Testing and evaluation

• Develop evaluation datasets with practice SMEs.
• Automate tests for groundedness, relevance, completeness, citation quality, task completion, response consistency, and escalation behavior.
• Perform adversarial testing involving prompt injection, data leakage, unsupported instructions, excessive agency, and unauthorized actions.
• Build regression tests to detect changes caused by models, prompts, source content, integrations, or application releases.
• Document known limitations and expected failure behavior.

Operations and improvement

• Instrument solutions for usage, latency, failures, cost, task completion, user feedback, and model behavior.
• Review production telemetry and interaction patterns.
• Investigate incidents and implement corrective changes.
• Optimize token consumption, retrieval performance, application latency, and integration reliability.
• Develop reusable agent templates, integration components, evaluation harnesses, and error-handling patterns.

Required Technical Skills

• Strong Python development skills.
• TypeScript or JavaScript development experience.
• REST APIs, JSON, OAuth, OpenAPI, webhooks, and event-driven integration.
• Copilot Studio, Power Automate, Azure AI Foundry, Azure OpenAI, and Azure AI Search.
• Microsoft Graph, Dataverse, SharePoint, and Teams integration.
• Retrieval-augmented generation, embeddings, vector search, semantic search, hybrid search, reranking, and structured generation.
• Agent orchestration, state management, tool invocation, and human-in-the-loop controls.
• Automated testing, Git, pull requests, CI/CD, and production troubleshooting.
• Application Insights, Azure Monitor, logging, alerting, and performance diagnostics.
• Understanding of prompt injection, data exfiltration, overreliance, hallucination, unsafe actions, and AI-specific failure modes.

Preferred Experience

• 5 or more years of software, integration, automation, or data application development.
• Demonstrated production experience with generative AI or conversational AI applications.
• Experience building applications across Copilot Studio, Power Platform, and Azure.
• Familiarity with Semantic Kernel or comparable orchestration frameworks.
• Basic C# experience within the Microsoft ecosystem.
• Experience in regulated, confidential, or professional-services environments.

Success Measures

• Evaluation performance against approved acceptance thresholds.
• Task-completion and appropriate-escalation rates.
• Production defect and regression rates.
• Retrieval and grounding quality.
• Response latency and cost per transaction.
• Integration reliability.
• Reuse of standard components.
• Completeness of technical documentation and automated testing.
• Speed and effectiveness of incident remediation.

Role Boundaries

This role engineers the behavior of AI applications. Practice SMEs remain accountable for defining and validating authoritative professional content, business rules, acceptable conclusions, and circumstances requiring human review.