Microsoft Fabric Data Lead

ValueMomentum; Pennsylvania; On-site; USD 150,000 - 190,000; Full time

Job summary

ValueMomentum seeks a Microsoft Fabric Core Lead Engineer to drive the design, development, and deployment of enterprise-scale data and analytics solutions using Microsoft Fabric. You will mentor teams, define architecture, and ensure scalable, secure platforms that meet business needs.

You will lead end-to-end Fabric implementation, optimize performance, and collaborate with stakeholders to translate analytics requirements into robust data solutions across environments.

Qualifications

• 10+ years of experience in Data Engineering, Data Warehousing, or Cloud Data Platform development.
• 4+ years hands-on experience with Microsoft Azure Data Platform technologies.
• 2+ years hands-on experience with Microsoft Fabric in enterprise implementations.
• Strong expertise in SQL, PySpark, Python, and Spark optimization.
• Experience with Microsoft Fabric components including OneLake, Lakehouse, Data Warehouse, Data Factory, Power BI, and Real-Time Intelligence.
• Experience with Azure Data Lake Storage (ADLS), Azure DevOps, GitHub, and CI/CD pipelines.
• Strong knowledge of dimensional data modeling, ETL/ELT architecture, and data governance.
• Experience leading technical teams and delivering large-scale enterprise data modernization programs.

Responsibilities

• Lead the end-to-end implementation of Microsoft Fabric solutions across enterprise programs.
• Define technical architecture, engineering standards, and best practices for Microsoft Fabric adoption.
• Provide technical leadership to a team of data engineers and developers.
• Review solution designs, code, and deployment strategies to ensure quality and scalability.
• Design and implement enterprise data platforms using Fabric components and ensure scalable analytics workloads.
• Architect reusable patterns and reference architectures for data platforms.
• Collaborate with business teams to translate analytical requirements into scalable data solutions.
• Lead production deployments, monitor platform health, and ensure SLA compliance.

Skills

SQL

PySpark

Python

Spark optimization

Azure Data Platform

Microsoft Fabric

Data Warehousing

Power BI

ETL/ELT design

CI/CD

Education

Bachelor's or Master's in CS/IT/Engineering

Tools

Microsoft Fabric

OneLake

Lakehouse

Data Warehouse

Data Factory

Power BI

ADLS

Azure DevOps

GitHub

CI/CD pipelines

Job description

The Microsoft Fabric Core Lead Engineer is responsible for leading the design, development, implementation, and support of enterprise-scale data and analytics solutions using Microsoft Fabric. The role provides technical leadership, drives architecture decisions, mentors engineering teams, and ensures successful delivery of scalable, secure, and high-performing data platforms.

Technical Leadership

• Lead the end-to-end implementation of Microsoft Fabric solutions across enterprise programs.
• Define technical architecture, engineering standards, and best practices for Microsoft Fabric adoption.
• Provide technical leadership to a team of data engineers and developers.
• Review solution designs, code, and deployment strategies to ensure quality and scalability.

Microsoft Fabric Architecture

• Design and implement enterprise data platforms using Microsoft Fabric components including OneLake, Lakehouse, Data Warehouse, Data Factory, Real-Time Intelligence, Data Engineering, and Power BI.
• Architect scalable, cloud-native data solutions supporting analytics, AI, and business intelligence workloads.
• Establish reusable design patterns and reference architectures.
• Design and develop robust ETL/ELT pipelines using Microsoft Fabric Data Factory and Spark Notebooks.
• Integrate structured, semi-structured, and unstructured data from cloud and on-premises systems.
• Implement data transformation, cleansing, validation, and orchestration processes.
• Optimize data ingestion strategies for performance and reliability.

Data Modeling & Analytics

• Design dimensional models, Lakehouse architectures, and enterprise data warehouses.
• Develop semantic models and datasets for Power BI reporting and self-service analytics.
• Collaborate with business teams to translate analytical requirements into scalable data solutions.

Performance Optimization

• Optimize Spark workloads, SQL Warehouse performance, and OneLake storage utilization.
• Implement partitioning, indexing, caching, and workload optimization strategies.
• Monitor platform performance and proactively resolve bottlenecks.

Security & Governance

• Implement enterprise security using Microsoft Entra ID, RBAC, and Fabric workspace security.
• Define governance policies for data quality, lineage, cataloging, auditing, and compliance.
• Ensure adherence to enterprise security, privacy, and regulatory standards.

DevOps & Automation

• Implement CI/CD pipelines using Azure DevOps or GitHub.
• Automate deployment of Microsoft Fabric artifacts across Development, QA, UAT, and Production environments.
• Manage source control, release management, and deployment automation.

AI & Advanced Analytics

• Enable AI, Machine Learning, and Copilot capabilities within Microsoft Fabric.
• Support Data Science workloads using Spark, notebooks, and ML models.
• Collaborate with AI teams to operationalize predictive analytics and intelligent data solutions.

Production Support & Operations

• Lead production deployments and post-production support activities.
• Monitor platform health, troubleshoot incidents, and ensure SLA compliance.
• Implement disaster recovery, backup, and business continuity strategies.

Stakeholder Management

• Collaborate with enterprise architects, product owners, business stakeholders, and cross-functional teams.
• Participate in architecture review boards and technical governance meetings.
• Communicate technical solutions and project status to senior leadership.
• Mentor junior and senior engineers on Microsoft Fabric technologies and engineering best practices.
• Conduct code reviews, design reviews, and technical knowledge-sharing sessions.
• Drive continuous improvement initiatives and foster engineering excellence.

Required Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
• 10+ years of experience in Data Engineering, Data Warehousing, or Cloud Data Platform development.
• 4+ years of hands‑on experience with Microsoft Azure Data Platform technologies.
• 2+ years of hands‑on experience with Microsoft Fabric in enterprise implementations.
• Strong expertise in SQL, PySpark, Python, and Spark optimization.
• Experience with Microsoft Fabric components including OneLake, Lakehouse, Data Warehouse, Data Factory, Power BI, and Real-Time Intelligence.
• Experience with Azure Data Lake Storage (ADLS), Azure DevOps, GitHub, and CI/CD pipelines.
• Strong knowledge of dimensional data modeling, ETL/ELT architecture, and data governance.
• Experience leading technical teams and delivering large-scale enterprise data modernization programs.

Preferred Skills

• Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
• Experience with Databricks, Synapse Analytics, Azure AI Services, or Microsoft Purview.
• Knowledge of Agile/Scrum delivery methodologies.
• Strong communication, stakeholder management, and problem-solving skills.

About ValueMomentum

ValueMomentum is a leading solutions provider for the global property and casualty insurance industry, supported by deep domain and technology capabilities. We help insurers stay ahead with sustained growth and high performance for enhancing stakeholder value and fostering resilient societies. Trusted by over 100 insurers, ValueMomentum is one of the largest services providers exclusively focused on property and casualty. ValueMomentum is headquartered in Piscataway, NJ, with state‑of‑the‑art delivery centers in Piscataway, NJ; Hyderabad, Pune, and Coimbatore in India; Toronto in Canada; and London in the United Kingdom.

ValueMomentum is an Equal Opportunity Employer committed to fostering a diverse and inclusive workplace. We make all employment decisions based on qualifications, merit, and business needs, without regard to race, color, religion, sex, gender identity or expression, sexual orientation, national origin, age, disability, protected veteran status, genetic information, or any other characteristic protected by applicable federal, state, or local law. We are also committed to providing reasonable accommodations to qualified individuals with disabilities and applicants throughout the recruitment process, in accordance with applicable laws.