Azure Data Engineer Azure Data Engineer Experience- 5 to 8 Years

Hoonartek; Pune District; On-site; INR 1,000,000 - 1,800,000; Full time

Job summary

Hoonartek seeks a skilled Data Engineer to design, develop, and maintain scalable data pipelines using Azure Synapse Analytics, Azure Data Factory, and Databricks. You will build robust ETL/ELT processes and optimize data warehouses while enabling cloud-based analytics solutions.

The ideal candidate will have hands-on experience with Synapse, Databricks, Spark/PySpark, and CI/CD practices on Azure DevOps. Strong SQL and data modeling skills are essential for this role.

Qualifications

• Hands-on experience with Azure Synapse Analytics (Dedicated SQL Pool, Serverless SQL Pool).
• Experience building ETL/ELT pipelines with Azure Data Factory and Synapse Pipelines.
• Strong SQL programming and query optimization skills.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Azure Synapse Analytics, Azure Data Factory, and SQL.
• Develop and optimize data ingestion frameworks for batch and incremental processing.
• Implement incremental loading using watermarking, CDC, or timestamp-based approaches.

Skills

Azure Synapse Analytics

Azure Data Factory

SQL

Incremental data processing

Data warehousing concepts

Tools

Databricks

Spark

PySpark

Azure DevOps

Git

ADLS Gen2

Job description

We are seeking a skilled Data Engineer with strong expertise in Azure Synapse Analytics and working knowledge of Databricks to design, develop, and maintain scalable data engineering solutions. The ideal candidate will be responsible for building robust ETL/ELT pipelines, implementing incremental data processing, optimizing data warehouse performance, and supporting cloud-based analytics platforms. Experience with Databricks will be an added advantage for modernizing and extending data platforms.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Azure Synapse Analytics, Azure Data Factory, and SQL.
• Develop and optimize data ingestion frameworks supporting both batch and incremental processing.
• Implement incremental loading using watermarking, Change Data Capture (CDC), Change Tracking, or timestamp-based approaches.
• Build and maintain enterprise data warehouse solutions using Azure Synapse Dedicated SQL Pools.
• Optimize SQL queries, indexing, partitioning, and table distribution for improved performance.
• Perform cost optimization and DWU right-sizing to balance performance and operational costs.
• Develop and maintain data models supporting reporting, analytics, and downstream applications.
• Work with Azure Data Lake Storage (ADLS Gen2) for data storage and management.
• Develop and support data processing workloads in Databricks using Spark/PySpark as required.
• Monitor pipeline execution, troubleshoot failures, and ensure reliable data delivery.
• Implement CI/CD pipelines using Azure DevOps and Git.
• Collaborate with architects, business analysts, and BI developers to deliver high-quality data solutions.
• Ensure data quality, governance, security, and compliance standards are met.

Job Requirements

• Strong hands-on experience with Azure Synapse Analytics (Dedicated SQL Pool, Serverless SQL Pool).
• Experience developing ETL/ELT pipelines using Azure Data Factory and Synapse Pipelines.
• Strong SQL programming and query optimization skills.
• Experience implementing incremental data processing, CDC, watermark-based ingestion, and metadata-driven pipelines.
• Good understanding of data warehousing concepts, dimensional modeling (Star/Snowflake), and performance tuning.
• Experience with Azure Data Lake Storage (ADLS Gen2).
• Working knowledge of Databricks, Spark, and PySpark.
• Experience with Azure DevOps, Git, and CI/CD.
• Strong analytical and troubleshooting skills.