Senior Data Engineer - Fabric & Data Pipelines

ADN Group; Oregon (WI); On-site; USD 120,000 - 180,000; Full time

Job summary

ADN Group is seeking a Senior Data Engineer to design and maintain scalable ETL/ELT pipelines using Microsoft Fabric, Delta Lake, and modern data architectures.

You will build Bronze-Silver-Gold layers, implement robust data models, and govern data with security and lineage while accelerating CI/CD deployments via Azure DevOps and Git. This role focuses on delivering high-performance data solutions for enterprise-scale analytics.

Qualifications

• Bachelor's degree in CS, Information Systems, Engineering, or a related field.
• 5+ years of core Data Engineering, BI, or Data Warehouse development experience.
• Strong hands-on expertise with Microsoft Fabric (Lakehouse, OneLake, Pipelines, Notebooks).
• Advanced SQL (T-SQL) capabilities for complex transformations, joins, and query optimization.
• High proficiency in Python or PySpark for data transformations and ingestion.
• Solid grasp of Kimball dimensional modeling, star schemas, and conformed dimensions.
• 3-5 years of hands-on experience with SSIS / SSMS / SSDT.
• Proven track record with CI/CD deployment via Azure DevOps / Git.

Responsibilities

• Pipeline Engineering: Design, build, and maintain scalable ETL/ELT pipelines using Microsoft Fabric (Dataflows Gen2, Pipelines, Notebooks, Spark) alongside legacy SSIS workflows.
• Medallion Architecture: Implement Bronze, Silver, and Gold layers utilizing Delta Lake, Warehouse, and OneLake structures.
• Data Modeling & Optimization: Build high-performance star schemas, handle SCD Type 1/2, and implement partitioning, Z-ordering, and compaction.
• Data Ingestion: Develop ingestion frameworks for REST APIs, SaaS platforms, flat files, cloud feeds, and partner integrations.
• Governance & Security: Implement Row-Level Security (RLS), object-level controls, and data governance/lineage via Microsoft Purview.
• Operational Excellence: Maintain CI/CD pipelines via Azure DevOps/Git and troubleshoot pipeline bottlenecks.

Skills

Microsoft Fabric

SQL (T-SQL)

Python / PySpark

Kimball dimensional modeling

SSIS / SSMS / SSDT

CI/CD with Azure DevOps / Git

Education

Bachelor's degree in CS, Information Systems, Engineering, or related field

Tools

Power BI

Azure Data Factory

Azure Synapse

Databricks

Job description

ADN Group is seeking a Senior Data Engineer to design and maintain scalable ETL/ELT pipelines using Microsoft Fabric, Delta Lake, and modern data architectures.

You will build Bronze-Silver-Gold layers, implement robust data models, and govern data with security and lineage while accelerating CI/CD deployments via Azure DevOps and Git. This role focuses on delivering high-performance data solutions for enterprise-scale analytics.