Cloud Data Engineer – Azure Fabric, Lakehouse, Power BI

SmartestEnergy Business Limited; Greater London; Hybrid; GBP 55,000 - 75,000; Full time

Job summary

SmartestEnergy Business Limited is seeking a Data Engineer to build cloud-based data solutions on Microsoft Azure. You will work on Data Factory, Synapse, Lakehouse, and Fabric to develop enterprise-scale pipelines and support data lakehouse and warehouse architectures.

You will contribute to data quality, governance, and reporting capabilities using Power BI, while aligning with CI/CD, testing, and collaborative reviews in a hybrid environment.

Qualifications

• Experience in a Data Engineering, Data Analytics, or Software Development role with ETL/ELT concepts.
• Strong PySpark for scalable data pipelines and SQL skills (T-SQL or Spark SQL) with Python knowledge.
• Hands-on with Microsoft Fabric and Azure Data Platform technologies (Data Factory, Synapse, Lakehouse, Data Piplines).
• Knowledge of Medallion Architecture, CI/CD, Azure DevOps, Agile/Scrum, and clean code practices.
• Understanding enterprise data warehousing, data quality, security, and governance.

Responsibilities

• Develop, test, and maintain reliable data pipelines and ETL/ELT processes.
• Support Data Lakehouse/Data Warehousing solutions and modern data architectures.
• Contribute to data quality, governance, and reporting capabilities (Power BI integration).
• Participate in code reviews, design sessions, and continuous learning with engineers and architects.

Skills

PySpark

SQL

Python

Azure DevOps

CI/CD

Agile/Scrum

Data governance

Medallion Architecture

Tools

Microsoft Fabric

Azure Data Factory

Azure Synapse

Azure Lakehouse

Notebooks

Power BI integration

Job description

SmartestEnergy Business Limited is seeking a Data Engineer to build cloud-based data solutions on Microsoft Azure. You will work on Data Factory, Synapse, Lakehouse, and Fabric to develop enterprise-scale pipelines and support data lakehouse and warehouse architectures.

You will contribute to data quality, governance, and reporting capabilities using Power BI, while aligning with CI/CD, testing, and collaborative reviews in a hybrid environment.