Lead Data Engineer - Fabric

iLink Digital; Pune District; On-site; INR 1,500,000 - 2,500,000; Full time

Job summary

A leading software solutions provider is seeking a highly skilled Lead Data Engineer with expertise in Microsoft Fabric to design and manage modern data platforms. The ideal candidate will lead data engineering solutions, mentor teams, and collaborate closely with business stakeholders. Strong proficiency in data pipelines, data modeling, and governance is essential. This role offers an opportunity to innovate and optimize data solutions in a dynamic environment.

Qualifications

• 7+ years of experience in Data Engineering, with at least 2+ years in Microsoft Fabric.
• Strong hands-on experience with PySpark and Fabric Data Engineering.
• Solid understanding of data modeling and data warehousing.

Responsibilities

• Lead the design and implementation of end-to-end data solutions.
• Build and optimize ETL/ELT pipelines using PySpark.
• Ensure strong data governance and quality across the ecosystem.

Skills

Data Engineering

Microsoft Fabric

PySpark

Dataflows Gen2

SQL performance tuning

Git

DevOps practices

Stakeholder management

Tools

Azure Data Lake Storage (ADLS)

Azure Synapse

Databricks

Power BI

Job description

iLink Digital is aGlobal Software Solution Provider and SystemsIntegrator, delivers next-generation technologysolutions to help clients solve complex businesschallenges, improve organizational effectiveness,increase business productivity, realize sustainableenterprise value and transform your businessinside-out. iLink integrates software systems and developscustom applications, components, and frameworks on the latestplatforms for IT departments, commercial accounts, applicationservices providers (ASP) and independent software vendors(ISV). iLink solutions are used in a broad range of industriesand functions, including healthcare, telecom, government, oiland gas, education, and life sciences. iLink’s expertiseincludes Cloud Computing & Application Modernization, DataManagement & Analytics, Enterprise Mobility, Portal,collaboration & Social Employee Engagement, EmbeddedSystems and User Experience designetc.

What makesiLink's offerings unique is the fact that we usepre-created frameworks, designed to accelerate softwaredevelopment and implementation of business processes for ourclients. iLink has over 60 frameworks (solution accelerators),both industry-specific and horizontal, that can be easilycustomized and enhanced to meet your current businesschallenges.

Requirements

We are looking for a highly skilled Lead Data Engineer with strong expertise in Microsoft Fabric to design, develop, and manage modern data platforms. The ideal candidate will drive end-to-end data engineering solutions, mentor the team, and collaborate closely with business and technical stakeholders to deliver scalable and high-performance data pipelines.

Key Responsibilities

• Lead the design and implementation of end-to-end data solutions on Microsoft Fabric, including Data Factory, Lakehouse, Warehouse, and Data Engineering experiences.
• Build and optimize ETL/ELT pipelines using PySpark, Dataflows Gen2, and Fabric pipelines.
• Architect and maintain Lakehouse and Delta Lake structures for large-scale data processing.
• Ensure strong data governance, quality, lineage, and security across the ecosystem.
• Work closely with data architects, analysts, and business partners to understand requirements and convert them into technical solutions.
• Oversee performance tuning, capacity planning, cost management, and platform optimization.
• Mentor junior data engineers and provide best practices for coding, design, and deployment.
• Implement CI/CD processes for Fabric workloads (Git integration, workspace management, DevOps).
• Troubleshoot data pipeline failures, production issues, and optimize workloads.
• Stay updated with Microsoft Fabric roadmap and bring innovative solutions into the architecture.

Required Skills & Experience

• 7+ years of experience in Data Engineering, with at least 2+ years in Microsoft Fabric or modern data platforms.
• Strong hands-on experience in:
  • PySpark / Spark SQL
  • Fabric Data Engineering, Lakehouse, Warehouse
  • Pipelines, Dataflows Gen2, KQL, Notebooks
  • Delta Lake and Medallion architecture
• Solid understanding of data modeling, data warehousing, and SQL performance tuning.
• Experience with Azure services: ADLS, Synapse, Data Factory, Databricks (added advantage).
• Expertise in Git, DevOps practices, and production deployment workflows.
• Strong analytical/problem-solving skills and stakeholder management capabilities.
• Experience leading a team or owning end-to-end delivery of data solutions.

Good to Have

• Knowledge of Power BI integration with Fabric
• Experience with Real-time analytics / Event streaming
• Familiarity with Python development and API integrations