Azure Data Engineer

NetConnectGlobal; Bengaluru; Hybrid; INR 1,800,000 - 2,800,000; Full time

Job summary

NetConnectGlobal in Bengaluru/Bangalore is seeking an experienced Azure Data Engineer to design, build, and optimize scalable data platforms and pipelines using Azure Data Factory, ADLS Gen2, Azure Databricks, and PySpark. The role involves implementing Medallion Architecture and end-to-end data integration for analytics and AI workloads.

You will collaborate with data scientists and architects to deliver Lakehouse solutions, ensure data governance and quality, and contribute to enterprise-scale

Qualifications

• 4-5 years of experience in Data Engineering, with strong hands-on Azure experience.
• Strong expertise in Azure Data Engineering.
• Hands-on experience with Azure Data Factory (ADF), ADLS Gen2, Azure Databricks, PySpark and Spark.
• Experience with Medallion Architecture (Bronze/Silver/Gold).
• Experience with CI/CD, preferably Azure DevOps or GitHub Actions.

Responsibilities

• Design, develop, and maintain scalable Azure-based data platforms and pipelines.
• Build data engineering solutions using ADF, ADLS Gen2, Databricks, PySpark, and Spark.
• Design and implement Medallion Architecture across Bronze, Silver, and Gold layers.
• Develop robust ETL/ELT pipelines and enterprise data integration solutions.
• Implement batch, streaming, and event-driven data ingestion pipelines.
• Implement CDC, incremental processing, upsert/merge, and idempotent processing.

Skills

Azure data engineering

Data pipelines

ETL/ELT

Medallion architecture

CI/CD

Data modeling

Analytics & AI

Tools

Azure Data Factory

ADLS Gen2

Azure Databricks

PySpark

Apache Spark

Azure Synapse Analytics

Azure SQL

Microsoft Fabric

Git

Azure DevOps

GitHub Actions

Job description

Role

Azure Data Engineer

Location

Gurgaon / Bangalore (Gurgaon Preferred)

Experience

4-5 Years

Duration

12 Months

Work Mode

Hybrid

Employment Type

FTE

Role Overview

We are looking for a skilled Azure Data Engineer with strong hands-on experience in Azure Data Services, Databricks, PySpark, Azure Data Factory, Data Lakes, and enterprise data integration. The role involves designing, developing, and optimizing scalable data platforms and pipelines that support analytics, AI, and Agentic AI use cases. The ideal candidate should be comfortable working independently on enterprise-scale data engineering and Lakehouse solutions.

Key Responsibilities

• Design, develop, and maintain scalable Azure-based data platforms and pipelines.
• Build data engineering solutions using Azure Data Factory, ADLS Gen2, Azure Databricks, PySpark, and Apache Spark.
• Design and implement Medallion Architecture across Bronze, Silver, and Gold layers.
• Develop robust ETL/ELT pipelines and enterprise data integration solutions.
• Implement batch, streaming, and event-driven data ingestion pipelines.
• Design and implement CDC, incremental processing, upsert/merge, and idempotent processing mechanisms.
• Integrate data from SAP, CRM systems, Microsoft platforms, REST APIs, SaaS applications, and third-party systems.
• Design and implement Lakehouse and ODS architectures.
• Work with Azure Synapse Analytics, Azure SQL, and Microsoft Fabric.
• Develop effective data models to support analytics, AI, and downstream applications.
• Implement CI/CD pipelines using Azure DevOps and/or GitHub Actions.
• Ensure high standards of data quality, governance, metadata management, and data lineage.
• Optimize data pipelines and workloads for performance, scalability, reliability, and cost efficiency.
• Collaborate with data scientists, AI engineers, architects, and application teams to deliver data solutions for modern analytics and AI workloads.

Must-Have Skills & Experience

• 4-5 years of experience in Data Engineering, with strong hands-on Azure experience.
• Strong expertise in Azure Data Engineering.
• Hands-on experience with :
• Azure Data Factory (ADF)
• Azure Data Lake Storage Gen2 (ADLS)
• Azure Databricks
• PySpark / Apache Spark
• Azure Synapse Analytics
• Azure SQL
• Microsoft Fabric
• Strong understanding and implementation experience with Medallion Architecture (Bronze/Silver/Gold).
• Strong ETL/ELT and enterprise data integration experience.
• Experience with batch, streaming, and event-driven data ingestion.
• Hands-on experience with CDC, incremental processing, upsert/merge, and idempotent processing.
• Experience integrating data from SAP, CRM, Microsoft platforms, REST APIs, SaaS, and third-party systems.
• Strong knowledge of data modeling, Lakehouse, and ODS architecture.
• Experience with Git and CI/CD, preferably Azure DevOps or GitHub Actions.
• Understanding of data quality, governance, metadata, and lineage.
• Strong analytical and problem-solving skills.

AI & Modern Data Platform Exposure

• Good exposure to :
• Azure AI Foundry
• Azure OpenAI
• Microsoft Copilot Studio
• Designing AI-ready and API-ready data models
• Supporting AI, Agentic AI, analytics, and microservices platforms

Good To Have

• Experience with Azure Cosmos DB.
• Knowledge of Azure Event Hubs.
• Experience with Azure Functions.
• Knowledge of Logic Apps and Service Bus.
• Experience with near real-time data processing.
• Experience integrating Retail, SAP, and CRM data.
• Cloud migration experience.
• Azure Data Engineer certification.

Ideal Candidate

The ideal candidate is a hands-on Azure Data Engineer capable of independently designing, developing, and optimizing enterprise-scale data pipelines and Lakehouse platforms. The candidate should have strong expertise in Databricks, PySpark, ADF, ADLS, and the broader Azure data ecosystem, along with an understanding of modern data platforms supporting analytics, AI, and Agentic AI workloads.

(ref:hirist.tech)