Lead Software Engineer - AI Solution Engineering

EPAM Systems Inc; Bengaluru; On-site; INR 3,500,000 - 6,000,000; Full time

Job summary

EPAM Systems Inc. in Bengaluru seeks a Lead Software Engineer - AI Solution Engineering to shape architecture and delivery standards for enterprise LLM-powered apps on Azure. You will design and ship end-to-end AI solutions, guiding cloud and coding best practices, and uphold Responsible AI across teams.

You will lead agentic AI development, deploy models to production, build APIs/microservices, and ensure robust CI/CD with Azure DevOps and GitHub Actions across AKS and App Service.

Qualifications

• 6–14 years of IT experience in software delivery and enterprise systems.
• Proficient in Python and C#, with REST/GraphQL API development and strong testing.
• Hands-on with Azure AI stack including Azure OpenAI, Azure AI Foundry and Cognitive Services.
• Knowledge of Azure AI Search, NLP, and vector databases (Cosmos DB, PostgreSQL).
• Experience with CI/CD (GitHub Actions) and standard coding practices (linters, formatting, PEP8).
• Containerization with Docker; deployment to AKS, App Service, or Functions.
• Awareness of security, secrets management (Key Vault) and RBAC; responsible AI principles.

Responsibilities

• Build full-stack LLM-powered AI apps on Azure using prompt engineering, grounding, RAG, and embeddings.
• Develop APIs and microservices in Python, C#, or Node; connect to UIs and enterprise systems.
• Lead agentic AI development with Azure AI Foundry and Copilot Studio.
• Implement CI/CD pipelines and coordinate deployments across AKS, App Service, and Functions.
• Create data and feature pipelines with Synapse, Databricks, or Data Factory; manage embeddings and prompt versioning.
• Deploy models to production and maintain them over time.
• Conduct health checks, audits, and code reviews to enforce standards and Responsible AI.

Skills

Python

C#

REST/GraphQL APIs

CI/CD

GitHub Actions

Azure AI stack

Responsible AI

Security & privacy

Tools

Azure OpenAI

Azure AI Foundry

Azure Cognitive Services

Azure Data Factory

Synapse

Databricks

Cosmos DB

PostgreSQL

Docker

AKS

App Service

Functions

Key Vault

RBAC

Job description

We are building enterprise LLM-powered applications on Azure and need a Lead Software Engineer - AI Solution Engineering to shape architecture and delivery standards. You will design and ship full-stack AI solutions, guide cloud and coding best practices, and uphold Responsible AI across teams

Responsibilities

• Build full-stack LLM-powered AI applications on Azure using prompt engineering, grounding, RAG, and vector databases
• Develop APIs and microservices in Python, .NET, or Node and connect them to UIs and enterprise systems
• Lead agentic AI development with Azure AI Foundry and Copilot Studio
• Implement CI/CD pipelines using GitHub Actions or Azure DevOps and coordinate deployments across AKS, App Service, and Functions
• Create data and feature pipelines with Azure Data Factory, Synapse, or Databricks and manage embeddings plus prompt versioning
• Deploy models to production and maintain them over time
• Conduct health checks, audits, and code reviews to enforce coding standards and AI principles and keep code clean, maintainable, and production-ready across teams

Requirements

• Extensive IT experience in the 6–14 year range across software delivery and enterprise systems
• Strong programming skills in Python and C#, plus building REST/GraphQL APIs with solid testing and code review practices
• Hands-on expertise with the Azure AI stack, including Azure OpenAI, Azure AI Foundry, and Azure Cognitive Services
• Working knowledge of Azure AI Search, NLP, and Azure ML, plus vector databases such as AI Search vector index, Cosmos DB, or PostgreSQL
• Practical experience in agentic development using the Azure AI stack
• Proven CI/CD capability with GitHub, branching strategies, and standards such as linters, formatters, and PEP8, including GitHub Actions pipelines
• Containerization skills with Docker and deployment experience to AKS, App Service, or Functions
• Knowledge of secrets management using Key Vault and Managed Identity, plus RBAC and basic network security concepts
• Clear understanding of Responsible AI, privacy, and data security for enterprise environments

Nice to have

• Experience using GitHub Copilot and Microsoft Copilot Studio (Power Platform)
• Familiarity with PromptFlow, MLflow, Databricks, and Streamlit or React
• Background in MLOps and/or LLMOps practices
• Azure certifications such as AI-102 and AZ-204
• Experience working with one of the big cloud environments (e.g. Azure)
• Knowledge of RAG patterns, prompt design, tool/function calling, embeddings, retrieval, caching
• Preferred experience working with Asset projects