Azure ETL Data Engineer

FuGenEd; Karnataka; On-site; INR 1,200,000 - 1,500,000; Full time

Job summary

FuGenEd is seeking an experienced Azure ETL Data Engineer to design, build, and maintain scalable ETL/ELT pipelines in Microsoft Azure. You will work across data migration, integration, and transformation tasks using ADF, Databricks, PySpark, Python, and SQL.

You will collaborate in an Agile environment, optimize queries and data models, and ensure robust orchestration, monitoring, and production support for end-to-end solutions at our Karnataka, India site.

Qualifications

• 6+ years of Data Engineering / ETL development experience.
• Minimum 3+ years hands-on Azure Data Engineering experience.
• Proven ability to design end-to-end data pipelines.
• Strong understanding of cloud data architecture and performance tuning.
• Bachelor's degree or equivalent technical qualification.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using ADF and Databricks.
• Migrate data from SQL Server to Microsoft Azure.
• Develop data transformation workflows using Python, PySpark, Spark, and SQL.
• Work with ADLS, Azure SQL Database, and Azure Synapse Analytics.
• Optimize SQL queries, data pipelines, and ETL processes.
• Implement data orchestration, scheduling, monitoring, and error handling.
• Develop relational and dimensional data models.
• Collaborate with cross-functional teams in an Agile environment.

Skills

Azure Data Factory

Azure Databricks

Azure Data Lake Storage

Azure SQL Database

Azure Synapse Analytics

Python / PySpark

SQL / T-SQL

SSIS

ETL/ELT Pipeline

Data Migration to Azure

Education

Bachelor's degree or equivalent

Tools

Git

Jenkins

Job description

Job Overview

We are looking for an experienced Azure ETL Data Engineer with strong hands-on expertise in Microsoft Azure data engineering technologies.

The ideal candidate should have experience in building scalable ETL/ELT pipelines, data migration, data integration, and transformation solutions using Azure Data Factory, Azure Databricks, PySpark, Python, and SQL.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory and Azure Databricks.
• Migrate data from SQL Server to Microsoft Azure.
• Develop data transformation workflows using Python, PySpark, Spark, and SQL.
• Work with Azure Data Lake Storage (ADLS), Azure SQL Database, and Azure Synapse Analytics.
• Optimize SQL queries, data pipelines, and ETL processes.
• Implement data orchestration, scheduling, monitoring, and error handling.
• Develop relational and dimensional data models.
• Handle end-to-end development, testing, deployment, and production support.
• Collaborate with cross-functional teams in an Agile environment.

Mandatory Technical Skills

• Azure Data Factory (ADF)
• Azure Databricks
• Azure Data Lake Storage (ADLS)
• Azure SQL Database
• Azure Synapse Analytics
• Python, PySpark, and Spark
• SQL Server and T-SQL
• SSIS
• ETL/ELT Pipeline Development
• SQL Server to Azure Data Migration
• Data Modelling (Relational & Dimensional)
• Git and Jenkins

Preferred Skills

• Microsoft Azure Data Engineer Certification (DP-203 or equivalent).
• Experience with Hadoop, Sqoop, and Shell Scripting.
• Knowledge of Java and Scala.
• Experience with CI/CD and automated deployments.
• Familiarity with JIRA, Confluence, and Microsoft Teams.
• Knowledge of Datadog, PowerShell, and cloud data architecture.

Candidate Requirements

• 6+ years of experience in Data Engineering / ETL Development.
• Minimum 3+ years of hands-on experience in Azure Data Engineering.
• Strong experience in designing and implementing end-to-end data pipelines.
• Good understanding of cloud data architecture and performance optimization.
• Bachelor's degree or equivalent technical qualification.

Pay: ₹1,200,000.00 - ₹1,500,000.00 per year

Work Location: In person