Senior Data Engineer: Microsoft Fabric Lakehouse

Quantum Technologies. LLC; Hartford (CT); On-site; USD 82,000 - 117,000; Full time

Job summary

Quantum Technologies. LLC seeks a Data Engineer to own design and delivery of data pipelines and analytics models on Microsoft Fabric for a client moving to a unified lake house platform.

You will shape solution design, lead hands‑on build, mentor junior developers, and serve as the day‑to‑day technical contact with business and IT stakeholders, working onsite in Hartford, CT. You will drive design reviews, performance tuning, and secure, governed production assets while delivering

Qualifications

• 8+ years in data engineering with end‑to‑end delivery on Microsoft Fabric: Lakehouse, Warehouse, Data Factory pipelines, notebooks, One Lake shortcuts, production deployment.
• Expert‑level SQL (T‑SQL) and PySpark/Python, with deep Delta Lake knowledge (ACID, partitioning, optimize/vacuum, schema evolution, performance tuning).
• Strong dimensional modelling and medallion architecture experience, including making and defending design trade‑offs.
• Experience with incremental loads, CDC patterns, and data quality frameworks at scale. Git‑based version control and CI/CD for data assets, with experience setting it up, not just using it.
• Demonstrated experience leading or mentoring a small team and doing code reviews.
• Strong communication skills for working directly with client stakeholders, including senior business and IT leaders.

Responsibilities

• Lead design and build of ingestion and transformation pipelines using Fabric Data Factory and Spark notebooks.
• Define Lakehouse vs Warehouse choices and the medallion layering on One Lake with Delta tables, and document the rationale.
• Design and optimize Power BI semantic models, including Direct Lake where appropriate, and guide report developers.
• Lead migration of existing workloads (SSIS, ADF, Synapse, on‑prem SQL Server) to Fabric, including assessment, sequencing, and cutover.
• Set up and own CI/CD using Fabric Git integration and deployment pipelines, including branching strategy and promotion standards.
• Define and enforce security and governance: workspace roles, row/column‑level security, sensitivity labels, Purview integration.
• Own performance and capacity management (CU consumption, throttling, SKU sizing inputs), and tune pipelines, Spark jobs, and queries.
• Conduct code and design reviews, set engineering standards, and mentor junior and mid‑level developers.
• Run requirement workshops and demos, estimate and break down work, flag risks early, and keep designs and runbooks current.

Skills

8+ years data engineering

SQL (T-SQL)

PySpark/Python

Delta Lake

Dimensional modelling

CDC patterns

CI/CD for data assets

Leadership / mentoring

Stakeholder communication

Tools

Fabric Data Factory

Spark notebooks

Azure DevOps / GitHub CI/CD

Purview

Delta tables

Job description

Quantum Technologies. LLC seeks a Data Engineer to own design and delivery of data pipelines and analytics models on Microsoft Fabric for a client moving to a unified lake house platform.

You will shape solution design, lead hands‑on build, mentor junior developers, and serve as the day‑to‑day technical contact with business and IT stakeholders, working onsite in Hartford, CT. You will drive design reviews, performance tuning, and secure, governed production assets while delivering