Azure Data Engineer Lead

Softview Infotech; Chennai; Hybrid; INR 2,500,000 - 5,000,000; Full time

Job summary

Softview Infotech is seeking a hands-on Azure Data Engineer Lead in Chennai/Bangalore to architect, build, and scale enterprise-grade data platforms on Microsoft Azure. You will lead a team of data engineers, define best practices, and collaborate with architects, analysts, and stakeholders to transform raw data into reliable, high-performance pipelines powering analytics and AI initiatives.

The role emphasizes end-to-end data architecture, governance, and cost optimization, with continued focus

Qualifications

• 8–10 years of data engineering experience.
• Hands-on Azure data platform architecture and leadership.

Responsibilities

• Lead design, development, and optimization of scalable data pipelines on Azure.
• Architect modern data lakehouse solutions using ADLS Gen2, Delta Lake, and Synapse.
• Define and enforce data engineering standards, CI/CD, and IaC practices across the team.
• Own end-to-end data architecture—ingestion, transformation, orchestration, and governance.
• Mentor engineers, conduct code reviews, and drive cloud cost optimization.

Skills

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

ADLS Gen2

PySpark

SQL

Python

Tools

Delta Lake

Terraform

Azure DevOps

Key Vault

Purview

Bicep

Job description

Location: Chennai, Bangalore

• Strong hands-on expertise in Azure Data Factory, Azure Databricks, Azure Synapse Analytics, ADLS Gen2
• Microsoft certifications: DP-203 (Azure Data Engineer Associate), Azure Solutions Architect

Role: Azure Data Engineer Lead

Experience: 8–10 Years

Location: Chennai, Bangalore

Key Skills: Azure Data Engineering, Azure Databricks, Azure Data Factory, PySpark, SQL

About The Role

We are looking for a hands-on Azure Data Engineer Lead to architect, build, and scale enterprise-grade data platforms on Microsoft Azure. You will lead a team of data engineers, define best practices, and partner with architects, analysts, and business stakeholders to turn raw data into reliable, high-performance pipelines that power analytics, reporting, and AI initiatives.

Key Responsibilities

• Lead the design, development, and optimization of scalable data pipelines using Azure Data Factory, Azure Databricks, and Synapse Analytics
• Architect modern data lakehouse solutions using ADLS Gen2, Delta Lake, and Synapse/Fabric
• Define and enforce data engineering standards, coding guidelines, and CI/CD practices across the team
• Own end-to-end data architecture — ingestion, transformation, orchestration, and governance
• Collaborate with data architects, BI teams, and business stakeholders to translate requirements into scalable technical solutions
• Optimize pipeline performance, cost, and reliability across large-scale distributed datasets
• Implement robust data quality, security, lineage, and monitoring frameworks (Purview, Key Vault, Log Analytics)
• Mentor and guide a team of data engineers; conduct code reviews and technical design sessions
• Drive cloud cost optimization and adherence to Azure Well-Architected Framework principles
• Stay current with emerging Azure data services and evaluate their adoption

Required Skills

• Strong hands-on expertise in Azure Data Factory, Azure Databricks, Azure Synapse Analytics, ADLS Gen2
• Proficiency in PySpark, SQL, and Python for large-scale data processing
• Experience with Delta Lake / Lakehouse architecture
• Strong understanding of data modeling (dimensional, star/snowflake schema)
• Experience with CI/CD pipelines (Azure DevOps) and Infrastructure-as-Code (Terraform/ARM/Bicep)
• Solid grasp of data governance, security, and compliance (RBAC, Azure Purview, encryption)
• Experience leading teams and managing project delivery in an Agile environment
• Strong communication and stakeholder management skills

Good To Have

• Experience with Microsoft Fabric / Power BI
• Exposure to Azure Event Hub / Stream Analytics for real-time processing
• Knowledge of MLOps or integration with Azure Machine Learning
• Microsoft certifications: DP-203 (Azure Data Engineer Associate), Azure Solutions Architect

Why Join Us?

• Work on cutting-edge cloud data platforms at enterprise scale
• Lead a talented team and shape data engineering practices from the ground up
• Competitive compensation, flexible work model, and continuous learning opportunities

Skills: databricks,pyspark,azure databricks,azure data engineering,azure data factory,sql,azure data engineer