Data Engineer

Weekday; Gurugram District; On-site; INR 400,000 - 1,300,000; Full time

Job summary

Weekday in India is seeking an experienced Data Engineer to design, develop, and optimize data pipelines in Azure and Fabric. You will work on lakehouse architectures, ETL/ELT processes, and data transformations across diverse sources, delivering scalable and cost-efficient data solutions.

The ideal candidate has 5+ years of Data Engineering experience, strong SQL, PySpark, and Python skills, and hands-on experience with Azure Data Factory and Microsoft Fabric Lakehouse.

Qualifications

• 5+ years of professional experience in Data Engineering, particularly within the Azure ecosystem.
• Strong hands-on experience with Microsoft Fabric, including Lakehouse, Dataflows Gen2, and Data Pipelines.
• Proficiency in Azure Data Factory and/or Microsoft Fabric Dataflows Gen2 for pipeline development and orchestration.
• Strong experience with data ingestion, ETL/ELT development, and transformation across structured and semi-structured data sources.
• Solid understanding of OneLake architecture and modern data lakehouse patterns.

Responsibilities

• Design, develop, and maintain scalable data engineering solutions using Azure and Microsoft Fabric.
• Build and orchestrate data pipelines using Azure Data Factory and Microsoft Fabric Dataflows Gen2.
• Develop robust ETL/ELT workflows for ingesting and transforming data.
• Work with OneLake and Lakehouse architectures to implement modern data lakehouse patterns.
• Develop efficient data transformations using SQL, PySpark, and Python.
• Optimize pipelines and compute resources to control cloud costs.
• Collaborate with business and analytics teams to translate data requirements into technical solutions.
• Ensure pipelines are reliable and maintainable following best practices.
• Troubleshoot data integration issues and implement improvements.
• Contribute to the evolution of Azure and Fabric-based data platform.

Skills

Azure

Microsoft Fabric

SQL

PySpark

Python

ETL/ELT

Lakehouse

OneLake

Azure Data Factory

Tools

Azure Data Factory

Microsoft Fabric Dataflows Gen2

Microsoft Fabric Lakehouse

SQL

PySpark

Python

Job description

This role is for one of Weekday’s clients
Salary range: Rs 400000 - Rs 1300000 (ie INR 4 - 13 LPA)

Min Experience: 5+ years
Location: Gurgaon, Haryana, India
JobType: full-time

We are seeking an experienced Data Engineer with strong expertise in the Azure ecosystem and Microsoft Fabric to design, develop, and optimize modern data engineering solutions. The ideal candidate will have hands‑on experience with lakehouse architecture, data pipelines, ETL/ELT processes, and data transformation across diverse data sources.

You will work closely with cross‑functional teams to understand data requirements and build scalable, reliable, and cost‑effective data solutions using Azure and Microsoft Fabric.

Requirements

Key Responsibilities

• Design, develop, and maintain scalable data engineering solutions using Azure and Microsoft Fabric.
• Build and orchestrate data pipelines using Azure Data Factory and Microsoft Fabric Dataflows Gen2.
• Develop robust ETL/ELT workflows for ingesting and transforming structured and semi-structured data.
• Work with Microsoft Fabric Lakehouse and OneLake to implement modern data lakehouse architectures.
• Develop efficient data transformations and integration workflows using SQL, PySpark, and Python.
• Optimize data pipelines, workloads, and compute resources to improve performance and control cloud processing costs.
• Collaborate with business, analytics, and technology teams to translate data requirements into scalable technical solutions.
• Ensure data pipelines are reliable, maintainable, and designed according to modern data engineering best practices.
• Troubleshoot data integration and pipeline issues and implement appropriate improvements.
• Contribute to the evolution of the organization's Azure and Fabric-based data platform.

Required Qualifications & Skills

• 5+ years of professional experience in Data Engineering, particularly within the Azure ecosystem.
• Strong hands‑on experience with Microsoft Fabric, including Lakehouse, Dataflows Gen2, and Data Pipelines.
• Proficiency in Azure Data Factory and/or Microsoft Fabric Dataflows Gen2 for pipeline development and orchestration.
• Strong experience with data ingestion, ETL/ELT development, and transformation across structured and semi-structured data sources.
• Solid understanding of OneLake architecture and modern data lakehouse patterns.
• Strong proficiency in SQL, PySpark, and Python for data integration and analytical workloads.
• Experience optimizing pipelines and managing compute resources for efficient and cost‑effective data processing.
• Strong analytical, troubleshooting, and problem‑solving abilities.
• Excellent collaboration and communication skills, with the ability to work effectively with cross‑functional teams.

Good‑to‑Have Skills

• Data Engineering
• Azure
• Lakehouse Architecture
• Additional experience across the Microsoft Fabric ecosystem
• Experience with modern cloud‑based data platforms and analytics workloads