Senior Data Engineer – Microsoft Fabric Lakehouse Lead

MACHINE LEARNING TECHNOLOGIES LLC; Hartford (CT); On-site; USD 84,000 - 116,000; Full time

Job summary

MACHINE LEARNING TECHNOLOGIES LLC in Hartford, CT is seeking a seasoned Data Engineer to design and deliver data pipelines and analytics models on Microsoft Fabric for a client moving to a unified lake house platform. You will lead hands-on build, mentor junior developers, and serve as the technical lead for business and IT stakeholders on site.

You will drive ingestion pipelines, medallion architecture decisions, and secure data assets while coordinating with BI teams and operations.

Qualifications

• 8+ years of data engineering with end-to-end delivery on Microsoft Fabric including Lakehouse, Data Factory pipelines, and notebooks.
• Expert-level SQL (T-SQL) and PySpark/Python with Delta Lake knowledge and performance tuning.
• Strong dimensional modelling and medallion architecture experience with sound trade-offs.
• Power BI semantic modelling and Direct Lake considerations for reporting.
• Experience with CDC, incremental loads, data quality, and CI/CD for data assets.

Responsibilities

• Lead design and build of ingestion and transformation pipelines on Fabric Data Factory and Spark notebooks.
• Define lakehouse vs warehouse strategies and medallion layering documentation.
• Design and optimize Power BI models and guide report developers.
• Lead migration of workloads to Fabric, including assessment and cutover planning.
• Set up and own CI/CD with Fabric Git integration and deployment pipelines.
• Define security and governance: workspace roles, data sensitivity, and Purview integration.
• Manage performance, capacity, and tuning of pipelines, Spark jobs, and queries.
• Conduct code reviews, mentor junior developers, and establish engineering standards.
• Run workshops, estimate work, and maintain current runbooks.

Skills

8+ years data engineering

Microsoft Fabric expertise

SQL (T-SQL)

PySpark/Python

Delta Lake knowledge

Power BI modelling

CDC patterns & data quality

Git CI/CD for data assets

Mentoring / code reviews

Tools

Microsoft Fabric

Azure DevOps

GitHub

Job description

MACHINE LEARNING TECHNOLOGIES LLC in Hartford, CT is seeking a seasoned Data Engineer to design and deliver data pipelines and analytics models on Microsoft Fabric for a client moving to a unified lake house platform. You will lead hands-on build, mentor junior developers, and serve as the technical lead for business and IT stakeholders on site.

You will drive ingestion pipelines, medallion architecture decisions, and secure data assets while coordinating with BI teams and operations.