Data Engineer: Fabric & Lakehouse Pipelines

AO Shearman; United States; Hybrid; USD 120,000 - 190,000; Full time

Benefits offered by this job

Pension scheme

Private medical insurance

Wellbeing resources

Hybrid work policy

Job summary

AO Shearman seeks a Microsoft Fabric Data Developer to design, build, and support cloud-based data solutions. You will create data pipelines, warehouses, lakehouses, and reporting tools enabling data-driven business decisions.

Responsibilities include end-to-end Fabric design, data ingestion pipelines from multiple sources, Medallion Architecture, ETL/ELT processes with Data Factory and Spark, and SQL/data models optimization, in a hybrid work environment.

Qualifications

• Strong SQL development skills.
• Experience designing and implementing ETL/ELT solutions.
• Knowledge of Lakehouse and Data Warehouse architectures.
• Experience with Data Pipelines, Dataflows Gen2, and Notebooks.
• Understanding of data modelling techniques, including star schemas and dimensional modelling.
• Experience with Power BI semantic models and reporting.
• Knowledge of data governance, security, and performance optimisation.
• Experience using Git and CI/CD deployment practices.

Responsibilities

• Design, build, and support modern cloud-based data solutions using Microsoft Fabric.
• Develop scalable data pipelines, data warehouses, lakehouses, and reporting solutions.
• Implement Medallion Architecture (Bronze, Silver, Gold) for quality and governance.
• Create and maintain ETL/ELT processes using Data Factory, pipelines, notebooks, and Spark.
• Develop, maintain, and optimize SQL scripts, stored procedures, and data models.
• Monitor and troubleshoot Fabric performance issues.

Skills

SQL development

ETL/ELT design

Data modelling

Data pipelines

Notebooks

Spark

Power BI

Git and CI/CD

Tools

SQL Server - T-SQL

Azure DevOps

Data Factory

Spark/Notebooks

Power BI semantic models

Job description

AO Shearman seeks a Microsoft Fabric Data Developer to design, build, and support cloud-based data solutions. You will create data pipelines, warehouses, lakehouses, and reporting tools enabling data-driven business decisions.

Responsibilities include end-to-end Fabric design, data ingestion pipelines from multiple sources, Medallion Architecture, ETL/ELT processes with Data Factory and Spark, and SQL/data models optimization, in a hybrid work environment.