Lead Data Engineer - Fabric

iLink Digital; Pune District; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

iLink Digital is seeking a Lead Data Engineer to design, develop, and manage modern data platforms using Microsoft Fabric. You will drive end-to-end data engineering solutions, mentor the team, and collaborate with business and technical stakeholders to deliver scalable, high-performance data pipelines.

The role requires 7+ years in data engineering with 2+ years in Fabric, hands-on PySpark/Spark SQL, and strong knowledge of Azure services, Data Factory, Lakehouse, and governance.

Qualifications

• 7+ years of experience in Data Engineering, with 2+ years on Microsoft Fabric.
• Hands-on PySpark and Spark SQL experience.
• Experience with Fabric Data Engineering, Lakehouse, Warehouse and Pipelines.
• Experience with Dataflows Gen2, KQL, and Notebooks.
• Strong data modeling, warehousing, and SQL tuning skills.
• Azure services (ADLS, Synapse, Data Factory, Databricks) experience.
• Git, DevOps practices, and production deployment workflows.
• Leadership of a team or end-to-end delivery ownership.

Responsibilities

• Lead end-to-end data engineering solutions on Microsoft Fabric.
• Design and implement ETL/ELT pipelines with PySpark and Fabric tools.
• Architect Lakehouse and Delta Lake structures for large-scale data processing.
• Ensure data governance, quality, lineage, and security across the ecosystem.
• Collaborate with data architects, analysts, and business partners to translate requirements.
• Oversee performance tuning, capacity planning, and cost management.
• Mentor junior engineers and promote best practices.
• Implement CI/CD for Fabric workloads and DevOps workflows.
• Troubleshoot data pipelines and production issues, optimize workloads.
• Stay updated with Fabric roadmap and bring innovations.

Skills

Data Engineering

Microsoft Fabric

PySpark

Spark SQL

Data Factory

Delta Lake

Lakehouse

SQL performance tuning

Azure services

DevOps

Python

Power BI

Real-time analytics

Event streaming

APIs

Tools

Fabric Data Engineering

Lakehouse

Warehouse

Dataflows Gen2

KQL

Databricks

ADLS

Synapse

Job description

iLink Digital is aGlobal Software Solution Provider and SystemsIntegrator, delivers next-generation technologysolutions to help clients solve complex businesschallenges, improve organizational effectiveness,increase business productivity, realize sustainableenterprise value and transform your businessinside-out. iLink integrates software systems and developscustom applications, components, and frameworks on the latestplatforms for IT departments, commercial accounts, applicationservices providers (ASP) and independent software vendors(ISV). iLink solutions are used in a broad range of industriesand functions, including healthcare, telecom, government, oiland gas, education, and life sciences. iLink’s expertiseincludes Cloud Computing & Application Modernization, DataManagement & Analytics, Enterprise Mobility, Portal,collaboration & Social Employee Engagement, EmbeddedSystems and User Experience designetc.

What makesiLink's offerings unique is the fact that we usepre-created frameworks, designed to accelerate softwaredevelopment and implementation of business processes for ourclients. iLink has over 60 frameworks (solution accelerators),both industry-specific and horizontal, that can be easilycustomized and enhanced to meet your current businesschallenges.

Requirements

We are looking for a highly skilled Lead Data Engineer with strong expertise in Microsoft Fabric to design, develop, and manage modern data platforms. The ideal candidate will drive end-to-end data engineering solutions, mentor the team, and collaborate closely with business and technical stakeholders to deliver scalable and high-performance data pipelines.

Key Responsibilities

• Lead the design and implementation of end-to-end data solutions on Microsoft Fabric, including Data Factory, Lakehouse, Warehouse, and Data Engineering experiences.
  
• Build and optimize ETL/ELT pipelines using PySpark, Dataflows Gen2, and Fabric pipelines.
  
• Architect and maintain Lakehouse and Delta Lake structures for large-scale data processing.
  
• Ensure strong data governance, quality, lineage, and security across the ecosystem.
  
• Work closely with data architects, analysts, and business partners to understand requirements and convert them into technical solutions.
  
• Oversee performance tuning, capacity planning, cost management, and platform optimization.
  
• Mentor junior data engineers and provide best practices for coding, design, and deployment.
  
• Implement CI/CD processes for Fabric workloads (Git integration, workspace management, DevOps).
  
• Troubleshoot data pipeline failures, production issues, and optimize workloads.
  
• Stay updated with Microsoft Fabric roadmap and bring innovative solutions into the architecture.
  

Required Skills & Experience

• 7+ years of experience in Data Engineering, with at least 2+ years in Microsoft Fabric or modern data platforms.
  
• Strong hands-on experience in:
  • PySpark / Spark SQL
    
  • Fabric Data Engineering, Lakehouse, Warehouse
    
  • Pipelines, Dataflows Gen2, KQL, Notebooks
    
  • Delta Lake and Medallion architecture
    
• Solid understanding of data modeling, data warehousing, and SQL performance tuning.
  
• Experience with Azure services: ADLS, Synapse, Data Factory, Databricks (added advantage).
  
• Expertise in Git, DevOps practices, and production deployment workflows.
  
• Strong analytical/problem-solving skills and stakeholder management capabilities.
  
• Experience leading a team or owning end-to-end delivery of data solutions.
  

Good to Have

• Knowledge of Power BI integration with Fabric
  
• Experience with Real-time analytics / Event streaming
  
• Familiarity with Python development and API integrations