Azure Data Engineer

Techknomatic Services; Pune District; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

Techknomatic Services is hiring an Azure Data Engineer in Pune, India. In this role, you will design and implement scalable ETL/ELT pipelines using Azure Data Factory, SQL, and Azure data services. You'll be responsible for building production-grade pipelines, integrating data from various sources, and optimizing SQL queries.

The ideal candidate has 3+ years of Azure Data Engineering experience, strong SQL skills, and a relevant degree. This position offers the opportunity to work with large-scale datasets and cloud-based solutions.

Qualifications

• 3+ years of experience in Azure Data Engineering or ETL development.
• Strong hands-on experience with Azure Data Factory (ADF) pipelines and activities.
• Expertise in SQL, including joins and query optimization.
• Good understanding of data warehousing and modern data architecture concepts.

Responsibilities

• Design and develop Azure Data Factory pipelines for data ingestion and transformation.
• Implement monitoring, logging, and error handling mechanisms for pipelines.
• Troubleshoot performance issues and maintain documentation.

Skills

Azure Data Factory

SQL

ETL/ELT Development

Data Integration

Data Warehousing

Education

Bachelor's or Master's degree in Computer Science, Engineering, or a related field

Tools

Azure Databricks

Apache Spark

Python

Job description

Job Description

Design and implement scalable ETL/ELT pipelines using Azure Data Factory, SQL, and Azure data services to support enterprise-scale data integration and analytics solutions.

About the role

As an Azure Data Engineer in Pune, you will build and optimize production-grade Azure Data Factory pipelines for enterprise data integration and transformation. You will work with large-scale datasets, orchestrate complex workflows, and develop scalable cloud-based data solutions using Azure services.

Responsibilities

• Design and develop Azure Data Factory pipelines for data ingestion and transformation.
• Build reusable and metadata-driven ETL/ELT pipeline frameworks.
• Implement parameterized pipelines, triggers, and workflow orchestration.
• Integrate data from databases, APIs, cloud storage, and enterprise applications.
• Develop data movement solutions between Azure Data Lake, SQL databases, and storage systems.
• Write and optimize complex SQL queries and stored procedures for data transformation.
• Implement monitoring, logging, retry logic, and error handling mechanisms for pipelines.
• Troubleshoot performance issues and maintain documentation and data lineage.

Job Requirement

• 3+ years of experience in Azure Data Engineering or ETL development.
• Strong hands-on experience with Azure Data Factory (ADF) pipelines and activities.
• Expertise in SQL, including joins, aggregations, stored procedures, and query optimization.
• Experience building ETL/ELT pipelines and handling large relational datasets.
• Good understanding of data warehousing, data lake, and modern data architecture concepts.
• Experience with Mapping Data Flows, linked services, datasets, and incremental data loading.
• Exposure to Azure Databricks, Apache Spark, or Python is a plus.
• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.