Azure Data Engineer (Manager)

HR India Solutions; Gurugram District; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

HR India Solutions seeks an Azure Data Engineer with 7+ years of experience to develop and maintain data solutions on Azure, including ADF, Synapse Analytics, and Databricks. The role emphasizes pipeline development, data migration to data lake, and ensuring data quality.

The ideal candidate will collaborate with stakeholders to translate requirements into scalable technical solutions and work with data architects to optimize performance and reliability of data workflows.

Qualifications

• 7+ years of experience with Azure data services including ADF, Synapse, and Databricks.
• Strong SQL, data transformation and ETL capabilities required.
• Hands-on experience with Python/PySpark for data processing.

Responsibilities

• Develop and implement data pipelines using Azure Data Factory and Databricks.
• Gather requirements from stakeholders and translate into technical solutions.
• Migrate data from diverse sources to Azure Data Lake.
• Optimize data processing workflows for performance and scalability.
• Ensure data quality and integrity through the data lifecycle.
• Collaborate with data architects to design and implement data solutions.

Skills

Azure Data Factory

Synapse Analytics

Databricks

SQL

Python

Pyspark

ETL

Data Lake migrations

Job description

About the Role:

We are looking for a skilled Azure Data Engineer with 7 yrs years of experience in Azure Data Services, including Azure Data Factory (ADF), Synapse Analytics, and Databricks. The candidate will play a key role in developing and maintaining data solutions on Azure.

Key Responsibilities:

• Develop and implement data pipelines using Azure Data Factory and Databricks.
• Work with stakeholders to gather requirements and translate them into technical solutions.
• Migrate data from various data sources to Azure Data Lake.
• Optimize data processing workflows for performance and scalability.
• Ensure data quality and integrity throughout the data lifecycle.
• Collaborate with data architects and other team members to design and implement data solutions.

Required Skills:

• Strong experience with Azure Data Services, including Azure Data Factory (ADF), Synapse Analytics, and Databricks.
• Proficiency in SQL, data transformation and ETL processes.
• Hands-on experience with Azure Data Lake migrations and Python/Pyspark
• Strong problem-solving and analytical skills.
• Excellent communication and teamwork skills.

Preferred Qualifications:

• Azure Data Engineer Associate certification.
• Databricks Certification.

Mandatory skill set:

• Pyspark- Databricks -
• Python and SqlRole & responsibilities

Preferred candidate profile

Perks and benefits