Lead Software Engineering - AI Solution Engineering

EPAM Systems Inc; Bengaluru; On-site; INR 4,000,000 - 6,600,000; Full time

Job summary

EPAM Systems Inc. seeks a Lead Software Engineering – AI Solution Engineering to deliver full-stack, LLM-driven AI products on Azure for enterprise use. You will build APIs and deployments, mature CI/CD and cloud architecture, and ensure Responsible AI and security practices are followed.

The role emphasizes hands-on coding in Python and C#, design of APIs, and deploying models with robust monitoring. You will mentor teams and drive enterprise-grade AI initiatives across projects.

Qualifications

• 6–14 years of IT experience with a track record of delivering production software.
• Hands-on coding with Python and C# including REST/GraphQL API development and code reviews.
• Deep familiarity with Azure OpenAI, Azure AI Foundry, and Azure Cognitive Services.

Responsibilities

• Design and build full-stack LLM-powered AI applications on Azure including prompt engineering, grounding, RAG, and vector DB usage.
• Implement APIs and microservices with Python, C#, or Node; integrate with UIs and enterprise platforms.
• Drive agentic AI development leveraging Azure AI Foundry and Copilot Studio.
• Deliver CI/CD automation with GitHub Actions or Azure DevOps; oversee deployments to AKS, App Service, and Functions.
• Develop data and feature pipelines via Azure Data Factory, Synapse, or Databricks; manage embeddings and prompt versioning.
• Release models into production and ensure stability, updates, and monitoring over time.
• Enforce coding standards and Responsible AI via health checks, audits, and reviews across teams.

Skills

Python

C#

REST/GraphQL APIs

CI/CD practices

Code reviews

Tools

Docker

AKS

Azure Data Factory/Synapse

Azure OpenAI / AI Foundry

GitHub Actions

Cosmos DB / PostgreSQL

Job description

We are looking for a Lead Software Engineering - AI Solution Engineering professional to deliver full-stack, LLM-driven AI products on Azure for enterprise use. You will build APIs and deployments, mature CI/CD and cloud architecture, and ensure Responsible AI and security practices are followed.

Responsibilities

• Design and build full-stack LLM-powered AI applications on Azure, including prompt engineering, grounding, RAG, and vector database usage
• Implement APIs and microservices with Python, .NET, or Node and integrate them with UIs and enterprise platforms
• Drive agentic AI development efforts leveraging Azure AI Foundry and Copilot Studio
• Deliver CI/CD automation with GitHub Actions or Azure DevOps and oversee deployments to AKS, App Service, and Functions
• Develop data and feature pipelines via Azure Data Factory, Synapse, or Databricks and handle embeddings management and prompt versioning
• Release models into production and keep them stable, updated, and monitored over time
• Enforce coding standards and Responsible AI principles through health checks, audits, and consistent code reviews across project teams

Requirements

• Overall IT experience of 6–14 years with a strong record of delivering production software
• Hands-on coding ability in Python and C#, including REST/GraphQL API development, testing, and participating in code reviews
• Deep familiarity with Azure OpenAI, Azure AI Foundry, and Azure Cognitive Services within the Azure AI stack
• Exposure to Azure AI Search, NLP, and Azure ML, along with vector databases like AI Search vector index, Cosmos DB, or PostgreSQL
• Experience creating agentic solutions using the Azure AI stack
• Proficiency with GitHub-based CI/CD, branching strategies, and coding standards (linters, formatters, PEP8), including GitHub Actions pipelines
• Experience packaging services with Docker and deploying to AKS, App Service, or Functions
• Working knowledge of Key Vault and Managed Identity for secrets management, plus RBAC and network security fundamentals
• Understanding of Responsible AI, privacy requirements, and data security in enterprise settings

Nice to have

• Hands-on use of GitHub Copilot and Microsoft Copilot Studio (Power Platform)
• Exposure to PromptFlow, MLflow, Databricks, plus Streamlit or React
• Familiarity with MLOps and/or LLMOps practices
• Azure certifications including AI-102 or AZ-204
• Experience working with one of the big cloud environments (e.g. Azure)
• Understanding of RAG patterns, prompt design, tool/function calling, embeddings, retrieval, and caching
• Preferred experience working with Asset projects