Data Engineer - Microsoft Fabric

SourcingXPress; Bengaluru; On-site; INR 2,500,000 - 5,000,000; Full time

Job summary

Hallmark Search Partner is seeking an experienced Microsoft Fabric Engineer to architect and deliver enterprise-scale data platforms using the Fabric ecosystem. You will design OneLake, Lakehouse, data pipelines, and data transformation solutions while modernising legacy workloads.

Collaboration with data engineers, analysts, data scientists, and business stakeholders is required. Strong expertise in Microsoft Fabric, Azure Data Factory, PySpark, SQL, and Azure data platforms is essential to

Qualifications

• 8+ years in Data Engineering; 2+ years with Microsoft Fabric or related Azure data platforms.
• Hands-on with Fabric workloads: Lakehouse, Data Warehouse, Data Factory, OneLake, Real-Time Analytics.
• Deep experience with ADF: pipeline design, orchestration, linked services, triggers, monitoring, migration to Fabric.
• Strong PySpark, Python, SQL; Spark optimisation, partitioning, caching, joins, shuffle.
• Design OneLake/Lakehouse architectures, medallion architecture, Delta/Parquet, DirectLake with Power BI.
• Hands-on with SSIS/SSRS; ETL and reporting migrations to Fabric/Power BI.
• Azure fundamentals: ADLS Gen2, Synapse, Key Vault, RBAC; CI/CD; Terraform/Bicep.
• DP-600, DP-203 or equivalent certifications; experience with Purview, Eventstream, Power BI Premium; data mesh preferred.

Responsibilities

• Lead end-to-end Microsoft Fabric data solutions: Lakehouse, Data Warehouse, Data Factory, Real-Time Analytics.
• Govern OneLake structures, workspace organization, data domains, access controls, platform standards.
• Build scalable data pipelines with Azure Data Factory and Fabric Data Pipelines.
• Develop and optimise PySpark transformations in Fabric Notebooks and Spark workloads.
• Design Delta/Parquet Lakehouse architectures; medallion architecture; DirectLake integration with Power BI.
• Migrate legacy SSIS/SSRS to Fabric, Power BI solutions.
• Implement CI/CD, monitoring, governance, security; automate infra with Azure DevOps/GitHub Actions, Bicep or Terraform.
• Lead technical discussions, mentor data engineers, collaborate with analysts and business stakeholders.

Skills

Microsoft Fabric

Azure Data Factory

PySpark

SQL

Power BI

Azure Synapse

Delta/Parquet

OneLake

CI/CD

Terraform/Bicep

Tools

Azure DevOps

GitHub Actions

Job description

Job Description

This is a permanent role with a valued client of Hallmark Search Partner

Description

We are looking for an experienced Microsoft Fabric Engineer to architect and deliver enterprise-scale data platforms using the Microsoft Fabric ecosystem. The role involves designing OneLake, Lakehouse, data pipelines, and data transformation solutions while modernising legacy data workloads. The candidate will work closely with data engineers, analysts, data scientists, and business stakeholders to deliver scalable data solutions. Strong expertise in Microsoft Fabric, Azure Data Factory, PySpark, SQL, and Azure data platforms is required.

Company: Hallmark Search Partner

Business Type: Enterprise

Company Type: Service

Business Model: B2C

Funding Stage: IPO/Public

Industry: Software Development

Responsibilities

• Lead the design and implementation of end-to-end Microsoft Fabric data solutions, including Lakehouse, Data Warehouse, Data Factory, and Real-Time Analytics.
• Architect and govern OneLake structures, workspace organisation, data domains, access controls, and platform standards.
• Build and maintain scalable data pipelines using Azure Data Factory and Fabric Data Pipelines.
• Develop and optimise PySpark transformation logic using Fabric Notebooks and Spark workloads.
• Design and optimise Delta/Parquet-based Lakehouse architectures, including medallion architecture and DirectLake integration with Power BI.
• Assess, migrate, and modernise legacy SSIS packages and SSRS reports using Fabric, ADF, and Power BI.
• Implement CI/CD, monitoring, governance, security, and infrastructure automation using Azure DevOps/GitHub Actions, Bicep, or Terraform.
• Lead technical discussions and reviews, mentor data engineers, and collaborate with analysts, data scientists, and business stakeholders.

Requirements

• 8+ years of experience in Data Engineering, with at least 2 years of hands‑on experience with Microsoft Fabric or closely related Azure data platforms.
• Strong hands‑on expertise across Microsoft Fabric workloads, including Lakehouse, Data Warehouse, Data Factory, OneLake, and Real‑Time Analytics.
• Deep experience with Azure Data Factory, including pipeline design, orchestration, linked services, triggers, parameterisation, monitoring, and migration to Fabric.
• Strong PySpark, Python, and SQL skills with experience in Spark optimisation, partitioning, caching, broadcast joins, and shuffle optimisation.
• Proven experience designing OneLake/Lakehouse architectures, medallion architecture, Delta/Parquet, data domain management, and DirectLake integration.
• Hands‑on experience with SSIS and SSRS, including ETL development, report development, and migration to modern Fabric/Power BI solutions.
• Strong Azure fundamentals including ADLS Gen2, Azure Synapse, Key Vault, RBAC, CI/CD, and exposure to Terraform/Bicep.
• Strong technical leadership and communication skills; DP‑600, DP‑203, or equivalent certifications and experience with Purview, Eventstream, Power BI Premium, or data mesh are preferred.