Microsoft Fabric Data Engineer

Derextechnologiesinc; Erie (Erie County); On-site; USD 120,000 - 160,000; Full time

Job summary

Derextechnologiesinc seeks a Microsoft Fabric Data Engineer to lead the design, development, and deployment of enterprise-scale data and analytics solutions using Microsoft Fabric. You will provide technical leadership, shape architecture, and mentor teams to deliver scalable, secure data platforms.

Responsibilities include end-to-end Fabric implementations, data integration, ETL/ELT pipelines, advanced data modeling for Lakehouse and Power BI reporting, performance tuning, governance, and CI/CD

Qualifications

• Bachelor's or Master's degree in Computer Science, IT, Engineering, or related field.
• 10+ years of experience in Data Engineering, Data Warehousing, or Cloud Data Platform development.
• 4+ years of hands-on experience with Microsoft Azure Data Platform technologies.
• 2+ years of hands-on experience with Microsoft Fabric in enterprise implementations.
• Strong expertise in SQL, PySpark, Python, and Spark optimization.
• Experience with Fabric components including OneLake, Lakehouse, Data Warehouse, Data Factory, Power BI, and Real-Time Intelligence.
• Experience with ADLS, Azure DevOps, GitHub, and CI/CD pipelines.
• Strong knowledge of dimensional data modeling, ETL/ELT architecture, and data governance.
• Experience leading technical teams and delivering large-scale enterprise data modernization programs.

Responsibilities

• Lead end-to-end implementation of Microsoft Fabric solutions across enterprise programs.
• Define technical architecture, engineering standards, and best practices for Fabric adoption.
• Provide technical leadership to a team of data engineers and developers.
• Review solution designs, code, and deployment strategies for quality and scalability.
• Design and implement enterprise data platforms using Fabric components like OneLake, Lakehouse, Data Warehouse, Data Factory, Power BI.
• Architect scalable cloud-native data solutions for analytics, AI, and BI workloads.
• Develop ETL/ELT pipelines using Fabric Data Factory and Spark Notebooks.
• Design dimensional models and data warehouses; support Power BI reporting.
• Lead production deployments, monitor platform health, ensure SLA compliance and governance.

Skills

SQL

PySpark

Python

Spark optimization

Azure

Fabric

OneLake

Lakehouse

Data Factory

Power BI

ETL/ELT

Education

Bachelor's degree

Master's degree

Tools

Azure DevOps

GitHub

CI/CD

ADLS

Job description

Title: Microsoft Fabric Data Engineer

Location: PA (Day 1 Onsite)

Overview

The Microsoft Fabric Core Lead Engineer is responsible for leading the design, development, implementation, and support of enterprise-scale data and analytics solutions using Microsoft Fabric. The role provides technical leadership, drives architecture decisions, mentors engineering teams, and ensures successful delivery of scalable, secure, and high-performing data platforms.

Roles & Responsibilities

Technical Leadership

• Lead the end-to-end implementation of Microsoft Fabric solutions across enterprise programs.
• Define technical architecture, engineering standards, and best practices for Microsoft Fabric adoption.
• Provide technical leadership to a team of data engineers and developers.
• Review solution designs, code, and deployment strategies to ensure quality and scalability.

Microsoft Fabric Architecture

• Design and implement enterprise data platforms using Microsoft Fabric components including OneLake, Lakehouse, Data Warehouse, Data Factory, Real-Time Intelligence, Data Engineering, and Power BI.
• Architect scalable, cloud-native data solutions supporting analytics, AI, and business intelligence workloads.
• Establish reusable design patterns and reference architectures.

Data Engineering & Integration

• Design and develop robust ETL/ELT pipelines using Microsoft Fabric Data Factory and Spark Notebooks.
• Integrate structured, semi-structured, and unstructured data from cloud and on-premises systems.
• Implement data transformation, cleansing, validation, and orchestration processes.
• Optimize data ingestion strategies for performance and reliability.

Data Modeling & Analytics

• Design dimensional models, Lakehouse architectures, and enterprise data warehouses.
• Develop semantic models and datasets for Power BI reporting and self-service analytics.
• Collaborate with business teams to translate analytical requirements into scalable data solutions.

Performance Optimization

• Optimize Spark workloads, SQL Warehouse performance, and OneLake storage utilization.
• Implement partitioning, indexing, caching, and workload optimization strategies.
• Monitor platform performance and proactively resolve bottlenecks.

Security & Governance

• Implement enterprise security using Microsoft Entra ID, RBAC, and Fabric workspace security.
• Define governance policies for data quality, lineage, cataloging, auditing, and compliance.
• Ensure adherence to enterprise security, privacy, and regulatory standards.

DevOps & Automation

• Implement CI/CD pipelines using Azure DevOps or GitHub.
• Automate deployment of Microsoft Fabric artifacts across Development, QA, UAT, and Production environments.
• Manage source control, release management, and deployment automation.

AI & Advanced Analytics

• Enable AI, Machine Learning, and Copilot capabilities within Microsoft Fabric.
• Support Data Science workloads using Spark, notebooks, and ML models.
• Collaborate with AI teams to operationalize predictive analytics and intelligent data solutions.

Production Support & Operations

• Lead production deployments and post-production support activities.
• Monitor platform health, troubleshoot incidents, and ensure SLA compliance.
• Implement disaster recovery, backup, and business continuity strategies.

Stakeholder Management

• Collaborate with enterprise architects, product owners, business stakeholders, and cross-functional teams.
• Participate in architecture review boards and technical governance meetings.
• Communicate technical solutions and project status to senior leadership.

Team Leadership & Mentoring

• Mentor junior and senior engineers on Microsoft Fabric technologies and engineering best practices.
• Conduct code reviews, design reviews, and technical knowledge-sharing sessions.
• Drive continuous improvement initiatives and foster engineering excellence.

Required Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
• 10+ years of experience in Data Engineering, Data Warehousing, or Cloud Data Platform development.
• 4+ years of hands‑on experience with Microsoft Azure Data Platform technologies.
• 2+ years of hands‑on experience with Microsoft Fabric in enterprise implementations.
• Strong expertise in SQL, PySpark, Python, and Spark optimization.
• Experience with Microsoft Fabric components including OneLake, Lakehouse, Data Warehouse, Data Factory, Power BI, and Real-Time Intelligence.
• Experience with Azure Data Lake Storage (ADLS), Azure DevOps, GitHub, and CI/CD pipelines.
• Strong knowledge of dimensional data modeling, ETL/ELT architecture, and data governance.
• Experience leading technical teams and delivering large-scale enterprise data modernization programs.

Preferred Skills

• Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
• Microsoft Azure Data Engineer Associate (DP-203)
• Experience with Databricks, Synapse Analytics, Azure AI Services, or Microsoft Purview.
• Knowledge of Agile/Scrum delivery methodologies.
• Strong communicatio