Westfield Lead Data Engineer

EXL Talent Acquisition Team; Gurugram District; Hybrid; INR 2,800,000 - 4,200,000; Full time

Job summary

EXL Talent Acquisition Team is seeking a senior data engineer to design and optimize cloud-based data pipelines using Azure Data Factory, Snowflake, and DBT. You will build end-to-end data integration workflows and translate business needs into scalable technical solutions.

The role requires 8+ years of data engineering experience with Azure and Snowflake, strong SQL skills, and a track record of delivering reliable data platforms in a cloud environment.

Qualifications

• 8+ years of experience in data engineering roles using Azure and Snowflake.
• Strong problem-solving, communication, and collaboration skills.
• Experience designing and building cloud-native data platforms and pipelines.

Responsibilities

• Design and develop ETL/ELT pipelines using Azure Data Factory, Snowflake, and DBT.
• Build and maintain data integration workflows from various data sources to Snowflake.
• Write efficient and optimized SQL queries for data extraction and transformation.
• Collaborate with stakeholders to translate business requirements into technical solutions.
• Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
• Maintain and enforce data quality, governance, and documentation standards.
• Collaborate with data analysts, architects, and DevOps teams in a cloud-native environment.

Skills

Azure Cloud Platform

Azure Data Factory (ADF)

SQL

Snowflake

SnowSQL

DBT

Cloud-based data environments

DataStage

Netezza

Azure Data Lake

Azure Synapse

Azure Functions

Python

PySpark

CI/CD pipelines

DevOps for data workflows

Data governance

Metadata management

Data catalog

Power BI

Education

Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field

Tools

Python

PySpark

Job description

Key Responsibilities:

• Design and develop ETL/ELT pipelines using Azure Data Factory, Snowflake, and DBT.
• Build and maintain data integration workflows from various data sources to Snowflake.
• Write efficient and optimized SQL queries for data extraction and transformation.
• Work with stakeholders to understand business requirements and translate them into technical solutions.
• Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
• Maintain and enforce data quality, governance, and documentation standards.
• Collaborate with data analysts, architects, and DevOps teams in a cloud-native environment.

Must-Have Skills:

• Strong experience with Azure Cloud Platform services.
• Proven expertise in Azure Data Factory (ADF) for orchestrating and automating data pipelines.
• Proficiency in SQL for data analysis and transformation.
• Hands-on experience with Snowflake and SnowSQL for data warehousing.
• Practical knowledge of DBT (Data Build Tool) for transforming data in the warehouse.
• Experience working in cloud-based data environments with large-scale datasets.

Good-to-Have Skills:

• Experience with DataStage, Netezza, Azure Data Lake, Azure Synapse, or Azure Functions.
• Familiarity with Python or PySpark for custom data transformations.
• Understanding of CI/CD pipelines and DevOps for data workflows.
• Exposure to data governance, metadata management, or data catalog tools.
• Knowledge of business intelligence tools (e.g., Power BI, Tableau) is a plus.

Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
• 8+ years of experience in data engineering roles using Azure and Snowflake.
• Strong problem-solving, communication, and collaboration skills.