Fabric Data Engineer - Lakehouse & Medallion Architect

Wall Street Consulting Services LLC; Center Square (PA); Presencial; USD 140.000 - 200.000; Jornada completa

Descripción de la vacante

Wall Street Consulting Services LLC in the United States seeks an experienced Microsoft Fabric Data Engineer to design, develop, and support modern data platforms using Microsoft Fabric, with emphasis on data integration, data warehousing, Lakehouse architecture, incremental loading, and governance.

You will build end-to-end data solutions, implement Medallion Architecture, optimize performance, and lead migration from legacy systems to Fabric, collaborating with stakeholders and reporting teams.

Formación

• 10+ years of Data Engineering experience.
• 2+ years of hands-on Microsoft Fabric experience.
• Experience implementing Lakehouse and Data Warehouse solutions.
• Strong understanding of Medallion Architecture and modern analytics platforms.

Responsabilidades

• Design and implement end-to-end data solutions using Microsoft Fabric.
• Develop and maintain Lakehouse and Data Warehouse architectures for enterprise analytics.
• Build scalable ETL/ELT pipelines using Fabric Data Factory and Fabric Notebooks.
• Design and implement incremental loading strategies for efficient data processing.
• Develop data ingestion frameworks and maintain historical data using SCD and CDC methodologies.
• Implement and manage Medallion Architecture (Bronze, Silver, Gold layers) for data transformation and governance.
• Configure and optimize Direct Lake and Direct Query datasets for reporting and analytics.
• Utilize Fabric capabilities such as Shortcuts, Mirroring, and Copy Activities for data integration.
• Monitor Fabric capacity utilization and perform capacity planning and optimization.
• Identify and troubleshoot bursting, smoothing, and throttling issues within Fabric workloads.
• Implement governance, security, and CI/CD processes for Fabric pipelines and workspaces.
• Lead migration initiatives from legacy data platforms into Microsoft Fabric.
• Collaborate with business stakeholders, architects, and reporting teams to deliver scalable analytics solutions.

Conocimientos

Microsoft Fabric

ETL/ELT development

Incremental loading

CDC

SCD

Data modeling

Data quality

Data lineage

Spark

PySpark

T-SQL

SQL optimization

Educación

Bachelor's degree in Computer Science, Information Systems, Engineering, or related field

Microsoft Fabric or Azure Data Engineering certification

Herramientas

Fabric Data Factory

Fabric Lakehouse

Fabric Warehouse

Fabric Notebooks

OneLake

Direct Lake Mode

Mirroring

Dataflows Gen2

Descripción del empleo

Wall Street Consulting Services LLC in the United States seeks an experienced Microsoft Fabric Data Engineer to design, develop, and support modern data platforms using Microsoft Fabric, with emphasis on data integration, data warehousing, Lakehouse architecture, incremental loading, and governance.

You will build end-to-end data solutions, implement Medallion Architecture, optimize performance, and lead migration from legacy systems to Fabric, collaborating with stakeholders and reporting teams.