Azure Lead Data Engineer

Ex; Gurugram District; On-site; INR 1,500,000 - 3,500,000; Full time

Job summary

Ex is seeking a senior data engineer to design and implement robust data pipelines in a cloud-native environment. You will work with Azure Data Factory, Snowflake, and DBT to move and transform large datasets, collaborate with stakeholders, and ensure data quality and governance across projects.

The role emphasizes building scalable data workflows and partnering with analytics teams to deliver actionable insights, with a strong focus on reliability and performance in a distributed cloud setup.

Qualifications

• Strong experience with Azure Cloud Platform services.
• Proven expertise in Azure Data Factory (ADF) for orchestrating and automating data pipelines.
• Proficiency in SQL for data analysis and transformation.
• Hands-on experience with Snowflake and SnowSQL for data warehousing.
• Practical knowledge of DBT for transforming data in the warehouse.
• Experience working in cloud-based data environments with large-scale datasets.

Responsibilities

• Design and develop ETL/ELT pipelines using Azure Data Factory, Snowflake, and DBT.
• Build and maintain data integration workflows from various data sources to Snowflake.
• Write efficient SQL queries for data extraction and transformation.
• Collaborate with stakeholders to translate business requirements into technical solutions.
• Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
• Maintain and enforce data quality, governance, and documentation standards.
• Collaborate with data analysts, architects, and DevOps teams in a cloud-native environment.

Skills

Azure Cloud Platform

SQL

Data integration

Cloud experience

Data engineering

Education

Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or related field

Tools

Azure Data Factory

Snowflake

SnowSQL

DBT

Python

PySpark

Power BI

Job description

Key Responsibilities:

• Design and develop ETL/ELT pipelines using Azure Data Factory, Snowflake, and DBT.


• Build and maintain data integration workflows from various data sources to Snowflake.


• Write efficient and optimized SQL queries for data extraction and transformation.


• Work with stakeholders to understand business requirements and translate them into technical solutions.


• Monitor, troubleshoot, and optimize data pipelines for performance and reliability.


• Maintain and enforce data quality, governance, and documentation standards.


• Collaborate with data analysts, architects, and DevOps teams in a cloud-native environment.

Must-Have Skills:

• Strong experience with Azure Cloud Platform services.


• Proven expertise in Azure Data Factory (ADF) for orchestrating and automating data pipelines.


• Proficiency in SQL for data analysis and transformation.


• Hands-on experience with Snowflake and SnowSQL for data warehousing.


• Practical knowledge of DBT (Data Build Tool) for transforming data in the warehouse.


• Experience working in cloud-based data environments with large-scale datasets.

Good-to-Have Skills:

• Experience with DataStage, Netezza, Azure Data Lake, Azure Synapse, or Azure Functions.


• Familiarity with Python or PySpark for custom data transformations.


• Understanding of CI/CD pipelines and DevOps for data workflows.


• Exposure to data governance, metadata management, or data catalog tools.


• Knowledge of business intelligence tools (e.g., Power BI, Tableau) is a plus.

Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field.


• 8+ years of experience in data engineering roles using Azure and Snowflake.


• Strong problem-solving, communication, and collaboration skills.