YASH Technologies is hiring a Lead Microsoft Fabric Data Engineer.
Role Overview
The Lead Microsoft Fabric Data Engineer will architect and lead the delivery of enterprise‑scale data platforms, owning end‑to‑end solution design across Lakehouse, Warehouse, and Real‑Time Intelligence. The role involves setting engineering standards, mentoring a pod of data engineers, and partnering with stakeholders to drive Fabric‑led modernization programs.
Experience Level: 8 to 10 Years (specifically 2–3 years in Microsoft Fabric)
Key Responsibilities
- Solution Architecture: Lead design for Fabric platforms including Lakehouse, Warehouse, Data Factory, Dataflows Gen2, and Notebooks.
- Modernization: Drive migration programs from legacy stacks like on‑prem DW, Synapse, Databricks, or Informatica to Microsoft Fabric.
- Platform Governance: Define Medallion architecture standards, OneLake organization, and workspace topology.
- Team Leadership: Manage and mentor a pod of 5–10 data engineers, conducting design and code reviews.
- Hands‑on Delivery: Build complex pipelines and semantic models for high‑volume, regulated workloads.
- DevOps & CI/CD: Establish environment strategies and release management using Azure DevOps or GitHub.
- Performance Optimization: Lead capacity planning, cost optimization, and reliability engineering for Fabric workloads.
- Governance & Security: Implement data governance via Microsoft Purview (lineage, sensitivity labels, RLS/OLS).
Must‑Have Skills
- 8+ years in data engineering, with 3+ years in a Lead or Architect capacity.
- 1–2 years of hands‑on experience with Microsoft Fabric (OneLake, Data Factory, Notebooks, etc.).
- Expert in PySpark, Spark SQL, and Delta Lake performance tuning.
- Expert‑level SQL and proven experience with Medallion/Lakehouse architectures and dimensional modeling.
- Strong experience with ADF, ADLS Gen2, Azure SQL, Synapse, and Key Vault.
- Working knowledge of Power BI Direct Lake, semantic modeling, and DAX.
Good‑to‑Have Skills
- Experience transitioning from Snowflake or Databricks to Fabric.
- Hands‑on with KQL, Eventstreams, or Activator for real‑time intelligence.
- Experience with SAP source systems (S/4HANA/BW) using CDS views or ODP.
- Certifications: Microsoft DP‑700, DP‑600, or DP‑203.
- Pre‑sales experience with effort estimation, RFP responses, and PoCs.
Soft Skills & Education
- Strong consulting and communication skills, able to translate business outcomes into technical roadmaps.
- People leadership: mentoring and growing engineering talent.
- Bachelor’s or Master’s degree in CS, IT, or Engineering.