Microsoft Fabric Data Engineer

Wall Street Consulting Services LLC; Center Square (PA); On-site; USD 140,000 - 200,000; Full time

Job summary

Wall Street Consulting Services LLC in the United States seeks an experienced Microsoft Fabric Data Engineer to design, develop, and support modern data platforms using Microsoft Fabric, with emphasis on data integration, data warehousing, Lakehouse architecture, incremental loading, and governance.

You will build end-to-end data solutions, implement Medallion Architecture, optimize performance, and lead migration from legacy systems to Fabric, collaborating with stakeholders and reporting teams.

Qualifications

• 10+ years of Data Engineering experience.
• 2+ years of hands-on Microsoft Fabric experience.
• Experience implementing Lakehouse and Data Warehouse solutions.
• Strong understanding of Medallion Architecture and modern analytics platforms.

Responsibilities

• Design and implement end-to-end data solutions using Microsoft Fabric.
• Develop and maintain Lakehouse and Data Warehouse architectures for enterprise analytics.
• Build scalable ETL/ELT pipelines using Fabric Data Factory and Fabric Notebooks.
• Design and implement incremental loading strategies for efficient data processing.
• Develop data ingestion frameworks and maintain historical data using SCD and CDC methodologies.
• Implement and manage Medallion Architecture (Bronze, Silver, Gold layers) for data transformation and governance.
• Configure and optimize Direct Lake and Direct Query datasets for reporting and analytics.
• Utilize Fabric capabilities such as Shortcuts, Mirroring, and Copy Activities for data integration.
• Monitor Fabric capacity utilization and perform capacity planning and optimization.
• Identify and troubleshoot bursting, smoothing, and throttling issues within Fabric workloads.
• Implement governance, security, and CI/CD processes for Fabric pipelines and workspaces.
• Lead migration initiatives from legacy data platforms into Microsoft Fabric.
• Collaborate with business stakeholders, architects, and reporting teams to deliver scalable analytics solutions.

Skills

Microsoft Fabric

ETL/ELT development

Incremental loading

CDC

SCD

Data modeling

Data quality

Data lineage

Spark

PySpark

T-SQL

SQL optimization

Education

Bachelor's degree in Computer Science, Information Systems, Engineering, or related field

Microsoft Fabric or Azure Data Engineering certification

Tools

Fabric Data Factory

Fabric Lakehouse

Fabric Warehouse

Fabric Notebooks

OneLake

Direct Lake Mode

Mirroring

Dataflows Gen2

Job description

We are seeking an experienced Microsoft Fabric Data Engineer to design, develop, and support modern data platforms using Microsoft Fabric. The ideal candidate should possess strong expertise in data integration, data warehousing, Lakehouse architecture, incremental data loading, data governance, and performance optimization within the Microsoft Fabric ecosystem. Experience with Azure data services and enterprise-scale data migration projects is highly preferred.

Key Responsibilities

• Design and implement end-to-end data solutions using Microsoft Fabric.
• Develop and maintain Lakehouse and Data Warehouse architectures for enterprise analytics.
• Build scalable ETL/ELT pipelines using Fabric Data Factory and Fabric notebooks.
• Design and implement incremental loading strategies for efficient data processing.
• Develop data ingestion frameworks and maintain historical data using SCD and CDC methodologies.
• Implement and manage Medallion Architecture (Bronze, Silver, Gold layers) for data transformation and governance.
• Configure and optimize Direct Lake and Direct Query datasets for reporting and analytics.
• Utilize Fabric capabilities such as Shortcuts, Mirroring, and Copy Activities for data integration.
• Monitor Fabric capacity utilization and perform capacity planning and optimization.
• Identify and troubleshoot bursting, smoothing, and throttling issues within Fabric workloads.
• Implement governance, security, and CI/CD processes for Fabric pipelines and workspaces.
• Lead migration initiatives from legacy data platforms into Microsoft Fabric.
• Collaborate with business stakeholders, architects, and reporting teams to deliver scalable analytics solutions.

Required Skills

Microsoft Fabric

• Strong hands-on experience with:
• Fabric Data Factory
• Fabric Lakehouse
• Fabric Warehouse
• Fabric Notebooks
• OneLake
• Direct Lake Mode
• Semantic Models
• Mirroring
• Dataflows Gen2
• Expertise in ETL/ELT development.
• Incremental loading implementation.
• Change Data Capture (CDC).
• Slowly Changing Dimensions (SCD).
• Data modeling and dimensional modeling.
• Data quality and data lineage management.
• Spark and PySpark.
• T-SQL and SQL optimization.

Governance & Performance

• Capacity planning and workload management.
• Workspace governance and security controls.
• Monitoring and troubleshooting Fabric throttling.
• CI/CD and Deployment Pipelines.

Preferred Qualifications

• Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
• Microsoft Fabric or Azure Data Engineering certification preferred.
• Experience with enterprise-scale cloud data migration projects.
• Knowledge of Power BI and semantic modeling.

Required Experience

• 10+ years of Data Engineering experience.
• 2+ years of hands-on Microsoft Fabric experience.
• Experience implementing Lakehouse and Data Warehouse solutions.
• Strong understanding of Medallion Architecture and modern analytics platforms.

Nice to Have

• Power BI Administration.
• Data Governance frameworks.
• Real-time analytics and streaming solutions.