Microsoft Fabric Data Engineer

Derex Technologies Inc; Erie (Erie County); On-site; USD 150,000 - 190,000; Full time

Job summary

Derex Technologies Inc. is seeking a Microsoft Fabric Data Engineer to lead enterprise-scale data and analytics initiatives. You will shape architecture, drive best practices, and mentor engineers across Fabric-based platforms.

The role emphasizes end-to-end delivery, governance, and collaboration with stakeholders to enable AI-driven insights and high-performing data solutions.

Qualifications

• 10+ years of experience in Data Engineering, Data Warehousing, or Cloud Data Platform development.
• 4+ years hands-on experience with Microsoft Azure Data Platform technologies.
• 2+ years hands-on experience with Microsoft Fabric in enterprise implementations.
• Strong expertise in SQL, PySpark, Python, and Spark optimization.
• Experience with Microsoft Fabric components including OneLake, Lakehouse, Data Warehouse, Data Factory, Power BI, and Real-Time Intelligence.
• Experience with Azure Data Lake Storage (ADLS), Azure DevOps, GitHub, and CI/CD pipelines.
• Strong knowledge of dimensional data modeling, ETL/ELT architecture, and data governance.
• Experience leading technical teams and delivering large-scale enterprise data modernization programs.

Responsibilities

• Lead end-to-end implementation of Microsoft Fabric solutions across enterprise programs.
• Define technical architecture, engineering standards, and best practices for Fabric adoption.
• Provide technical leadership to a team of data engineers and developers.
• Review solution designs, code, and deployment strategies to ensure quality and scalability.
• Design scalable data platforms using Fabric components (OneLake, Lakehouse, Data Warehouse, Data Factory, Power BI).
• Architect data pipelines and governance strategies for security and compliance.
• Establish CI/CD pipelines and automate deployment of Fabric artifacts across environments.
• Mentor engineers and collaborate with stakeholders to deliver analytics and AI capabilities.

Skills

SQL

PySpark

Python

Spark optimization

Education

Bachelor's or Master's degree in CS/IT/Engineering

Tools

OneLake

Lakehouse

Data Warehouse

Data Factory

Power BI

Real-Time Intelligence

Azure DevOps

GitHub

CI/CD

Job description

Derex Technologies Inc specializes in providing IT consulting, staffing solutions and software services. Globally headquartered in Harrison New Jersey since 1996 Derex delivers the highest quality technology professionals and an array of customized IT talent solutions designed to improve productivity and drive results to global clients throughout North America.

With over two decades of unparalleled experience, Derex provides supports to its clientele, across such industries as Systems Integration, Banking and Finance, Telecommunications, Pharmaceutical and Life Sciences, Energy, Healthcare, Technology, Transportation, and local and federal Government agencies.

Job Description

Title: Microsoft Fabric Data Engineer

Location: PA (Day 1 Onsite)

Overview

The Microsoft Fabric Core Lead Engineer is responsible for leading the design, development, implementation, and support of enterprise-scale data and analytics solutions using Microsoft Fabric. The role provides technical leadership, drives architecture decisions, mentors engineering teams, and ensures successful delivery of scalable, secure, and high-performing data platforms.

Technical Leadership

• Lead the end-to-end implementation of Microsoft Fabric solutions across enterprise programs.
• Define technical architecture, engineering standards, and best practices for Microsoft Fabric adoption.
• Provide technical leadership to a team of data engineers and developers.
• Review solution designs, code, and deployment strategies to ensure quality and scalability.

Microsoft Fabric Architecture

• Design and implement enterprise data platforms using Microsoft Fabric components including OneLake, Lakehouse, Data Warehouse, Data Factory, Real-Time Intelligence, Data Engineering, and Power BI.
• Architect scalable, cloud-native data solutions supporting analytics, AI, and business intelligence workloads.
• Establish reusable design patterns and reference architectures.
• Design and develop robust ETL/ELT pipelines using Microsoft Fabric Data Factory and Spark Notebooks.
• Integrate structured, semi-structured, and unstructured data from cloud and on-premises systems.
• Implement data transformation, cleansing, validation, and orchestration processes.
• Optimize data ingestion strategies for performance and reliability.

Data Modeling & Analytics

• Design dimensional models, Lakehouse architectures, and enterprise data warehouses.
• Develop semantic models and datasets for Power BI reporting and self-service analytics.
• Collaborate with business teams to translate analytical requirements into scalable data solutions.

Performance Optimization

• Optimize Spark workloads, SQL Warehouse performance, and OneLake storage utilization.
• Implement partitioning, indexing, caching, and workload optimization strategies.
• Monitor platform performance and proactively resolve bottlenecks.

Security & Governance

• Implement enterprise security using Microsoft Entra ID, RBAC, and Fabric workspace security.
• Define governance policies for data quality, lineage, cataloging, auditing, and compliance.
• Ensure adherence to enterprise security, privacy, and regulatory standards.

DevOps & Automation

• Implement CI/CD pipelines using Azure DevOps or GitHub.
• Automate deployment of Microsoft Fabric artifacts across Development, QA, UAT, and Production environments.
• Manage source control, release management, and deployment automation.

AI & Advanced Analytics

• Enable AI, Machine Learning, and Copilot capabilities within Microsoft Fabric.
• Support Data Science workloads using Spark, notebooks, and ML models.
• Collaborate with AI teams to operationalize predictive analytics and intelligent data solutions.

Production Support & Operations

• Lead production deployments and post-production support activities.
• Monitor platform health, troubleshoot incidents, and ensure SLA compliance.
• Implement disaster recovery, backup, and business continuity strategies.

Stakeholder Management

• Collaborate with enterprise architects, product owners, business stakeholders, and cross-functional teams.
• Participate in architecture review boards and technical governance meetings.
• Communicate technical solutions and project status to senior leadership.
• Mentor junior and senior engineers on Microsoft Fabric technologies and engineering best practices.
• Conduct code reviews, design reviews, and technical knowledge-sharing sessions.
• Drive continuous improvement initiatives and foster engineering excellence.

Required Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
• 10+ years of experience in Data Engineering, Data Warehousing, or Cloud Data Platform development.
• 4+ years of hands-on experience with Microsoft Azure Data Platform technologies.
• 2+ years of hands-on experience with Microsoft Fabric in enterprise implementations.
• Strong expertise in SQL, PySpark, Python, and Spark optimization.
• Experience with Microsoft Fabric components including OneLake, Lakehouse, Data Warehouse, Data Factory, Power BI, and Real-Time Intelligence.
• Experience with Azure Data Lake Storage (ADLS), Azure DevOps, GitHub, and CI/CD pipelines.
• Strong knowledge of dimensional data modeling, ETL/ELT architecture, and data governance.
• Experience leading technical teams and delivering large-scale enterprise data modernization programs.

Preferred Skills

• Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
• Experience with Databricks, Synapse Analytics, Azure AI Services, or Microsoft Purview.
• Knowledge of Agile/Scrum delivery methodologies.
• Strong communication, stakeholder management, and problem-solving skills.

Additional Information

All your information will be kept confidential according to EEO guidelines.