Data Engineer – Microsoft Fabric

Zohorecruit; Bengaluru; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

Zohorecruit in Bengaluru is seeking a Senior Associate Data Engineer with 3–6 years of experience to design and implement scalable data platforms using Microsoft Fabric. You will build end-to-end data pipelines, collaborate with data scientists, and enable AI-driven analytics for global clients.

The role focuses on batch and streaming data integration, lakehouse architectures, data quality, and governance, with close alignment to Azure Data Lake Storage, Synapse Analytics, and Power BI

Qualifications

• Bachelor's/Master's degree in CS/Engineering or related field.
• 3–6 years of hands-on data engineering experience with Microsoft Fabric.
• Strong hands-on experience with Fabric Lakehouse, OneLake, Data Factory/Pipelines, Dataflows Gen2, and Fabric Notebooks.
• Strong SQL skills including complex queries, data transformation, optimization and data modeling.
• Strong Python and/or PySpark experience for data transformation and pipeline development.
• Experience designing ETL/ELT pipelines and integrating data from APIs, databases, files, and enterprise systems.
• Experience implementing data quality, validation, reconciliation, and error-handling workflows.
• Experience with data matching, entity resolution, deduplication, record linkage.
• Working knowledge of Azure Data Lake Storage, Azure SQL, and/or Synapse Analytics.
• Understanding of data warehousing concepts and analytics-ready data design.
• Familiarity with Git, CI/CD, and DataOps practices.
• Understanding of data governance, security, lineage, metadata, and performance optimization.

Responsibilities

• Design, build, and maintain scalable data pipelines using Microsoft Fabric components.
• Develop OneLake/Fabric Lakehouse architectures for healthcare and enterprise data.
• Build and optimize batch and API-based ingestion pipelines from multiple data sources.
• Develop robust ETL/ELT workflows using SQL, Python, and PySpark.
• Implement data quality, validation, reconciliation, and anomaly-detection checks.
• Develop data standardization, deduplication, and entity-resolution workflows.
• Design analytics-ready datasets and data models for data scientists and ML pipelines.
• Collaborate with data scientists/ML engineers to prepare reliable feature-ready datasets.
• Integrate Microsoft Fabric with Azure data services where required.
• Implement incremental ingestion, change-data handling, and pipeline recovery strategies.
• Implement observability and monitoring using Azure Log Analytics and pipeline monitoring.
• Support data lineage, governance, security, and discoverability using Fabric Catalog or Purview.
• Optimize SQL queries, Spark transformations, and storage strategies for large-scale data.
• Support CI/CD, Git-based deployment automation, and DataOps practices for Fabric data solutions.

Skills

SQL

Python

PySpark

Microsoft Fabric

Azure Data Factory/Pipelines

Lakehouse

Education

Bachelor's/Master's in Computer Science or related field

Tools

Fabric Notebooks

OneLake

Power BI

Azure SQL

Azure Data Lake Storage

Job description

Bangalore South, India | Posted on 09/23/2026

Position: Senior Associate

Required Experience: 3–6 years

Role Summary

We’re looking for a skilled DataEngineer with Microsoft Fabric experience to join our growing data and AI team.In this role, you will design and build modern data platforms leveragingMicrosoft Fabric, enabling scalable analytics, AI-driven insights, andenterprise-grade data solutions for global clients. This is an excellentopportunity to work on next-generation data architectures, contribute toAI-driven transformation programs, and grow into advanced data engineering andplatform leadership roles.

Key Responsibilities

• Design, build, andmaintain scalable data pipelines using Microsoft Fabric Data Factory(Pipelines), Dataflows Gen2, Fabric Notebooks, and Lakehouse.
• Develop and manageOneLake/Fabric Lakehouse architectures for structured and semi-structuredhealthcare and enterprise data.
• Build and optimize batchand API-based ingestion pipelines from multiple enterprise data sources,databases, files, and application systems.
• Develop robust ETL/ELTworkflows using SQL, Python, and PySpark for data transformation andenrichment.
• Implement data quality,validation, reconciliation, completeness, consistency, and anomaly-detectionchecks across source and target datasets.
• Develop datastandardization, deduplication, entity-resolution, record-linkage, and matchingworkflows across heterogeneous data sources.
• Design analytics-readydatasets and data models for data scientists, analysts, ML pipelines, anddownstream applications.
• Collaborate closely withdata scientists and ML engineers to prepare reliable feature-ready andmodel-consumable datasets.
• Integrate Microsoft Fabricwith Azure data services such as Azure Data Lake Storage, Azure SQL, Synapsecomponents, and Power BI where required.
• Implement incrementalingestion, change-data handling, error handling, retry mechanisms, and pipelinerecovery strategies where applicable.
• Implement observabilityand monitoring using Azure Log Analytics, alerts, action groups, andpipeline-level monitoring.
• Support data lineage,metadata management, governance, security, and discoverability using FabricCatalog and/or Microsoft Purview.
• Optimize SQL queries,Spark transformations, storage strategies, and pipeline execution forlarge-scale datasets.
• Support CI/CD, Git-basedversion control, deployment automation, and DataOps practices for Fabric datasolutions.

Required Qualifications

• Bachelor’s/Master’s degreein Computer Science, Engineering, Data Engineering, or a related field, orequivalent practical experience.
• 3–6 years of hands‑on dataengineering experience, including practical Microsoft Fabric experience.
• Strong hands‑on experiencewith Microsoft Fabric Lakehouse, OneLake, Data Factory/Pipelines, DataflowsGen2, and Fabric Notebooks.
• Strong SQL skills,including complex queries, data transformation, optimization, and datamodeling.
• Strong Python and/orPySpark experience for data transformation and pipeline development.
• Experience designing andimplementing ETL/ELT pipelines and integrating data from APIs, databases,files, and enterprise systems.
• Experience implementingdata quality, validation, reconciliation, and error‑handling workflows.
• Experience with datamatching, entity resolution, deduplication, record linkage, or similar dataintegration workflows.
• Working knowledge of AzureData Lake Storage, Azure SQL, and/or Synapse Analytics.
• Understanding of datawarehousing concepts, dimensional modeling, and analytics‑ready data design.
• Familiarity with Git,CI/CD, deployment automation, and DataOps practices.
• Understanding of datagovernance, security, lineage, metadata, and performance optimization.

Preferred Qualifications

• Experience working withhealthcare/provider data.
• Experience integratingPower BI with enterprise data platforms.
• Exposure to MicrosoftPurview or Fabric Catalog.
• Experience withincremental/CDC ingestion and event-driven or near‑real‑time data pipelines.
• Exposure to Eventstream,Azure Event Hubs, or other streaming ingestion frameworks.