Data Engineer 12 month FTC

SmartestEnergy; Greater London; On-site; GBP 60,000 - 90,000; Full time

Benefits offered by this job

Flexible working: work from anywhere,

Job summary

SmartestEnergy is seeking a Data Engineer to design and deliver cloud-based data solutions using Azure Data Platform and Microsoft Fabric. You will build enterprise-scale data pipelines, support data lakehouse and data warehouse architectures, and collaborate with engineers and architects.

The role emphasizes data quality, governance, testing, and CI/CD practices, with exposure to Power BI integrations and modern data methodologies.

Qualifications

• Experience in Data Engineering, Data Analytics, or Software Development with ETL/ELT concepts.
• Strong PySpark and SQL skills with Python programming experience.
• Hands-on with Microsoft Fabric and Azure Data Platform technologies.

Responsibilities

• Develop and maintain enterprise-scale data pipelines and ETL/ELT processes.
• Support Data Lakehouse and Data Warehouse architectures and data governance.
• Collaborate on CI/CD, DevOps practices, and data quality initiatives.
• Enable reporting integration with Power BI and analytics workstreams.

Skills

PySpark

SQL

Python

ETL/ELT concepts

Azure Data Platform

Data Factory

Synapse

Lakehouse

Power BI

CI/CD

Azure DevOps

Agile/Scrum

Data governance

Medallion Architecture

Tools

Microsoft Fabric

Azure Data Platform

Data Factory

Synapse

Notebooks

Job description

Join our growing team as a Data Engineer and play a key role in building modern, cloud-based data solutions that enable better business decision-making. This is an excellent opportunity for someone experience and who is passionate about data, eager to learn, and excited to work with Microsoft's Azure Data Platform and Microsoft Fabric. You'll work on developing enterprise-scale data pipelines, supporting Data Lakehouse and Data Warehouse solutions, and working with modern data architectures under the guidance of experienced engineers and architects.

In this role, you'll contribute to the development, testing, and maintenance of reliable data pipelines, support ETL processes across the Medallion Architecture, and help ensure data quality, governance, and reporting capabilities. You will be familiar with Azure DevOps, CI/CD practices, Spark notebooks, and Power BI and participate in collaborative code reviews, design sessions, and continuous learning opportunities.

What skills/experience do I need to be successful?

• Experienced in a Data Engineering, Data Analytics, or Software Development role, with a good understanding of ETL/ELT concepts and data integration principles;
• Very strong PySpark for developing scalable data pipelines and data transformations and SQL skills (T-SQL and/or Spark SQL) and working knowledge of Python;
• Hands‑on experience with Microsoft Fabric and/or Azure Data Platform technologies, including Data Factory, Synapse, Lakehouse, Data Pipelines, Dataflows Gen2, Notebooks, and Power BI integration;
• Understanding of modern data engineering practices, including Medallion Architecture (Bronze/Silver/Gold), CI/CD, Azure DevOps, Agile/Scrum methodologies, testing, and clean code principles;
• Knowledge of enterprise data warehousing, semantic models, data quality, security, and governance, with a willingness to learn and apply emerging Microsoft Fabric capabilities such as Real‑Time Intelligence.

What sets us apart?

• Global Impact: With offices in the UK, US, and Australia, and plans for further expansion, you'll be part of a dynamic, globally‑minded team, with opportunities to explore new markets and make a difference on a global scale.
• Flexible Working: Embrace the freedom to work from anywhere in the world for up to 30 days a year. We prioritize work‑life balance, recognizing that your well‑being matters. Find out more here.
• Commitment to Diversity and Inclusion: We celebrate our diverse culture and value individuals irrespective of background, disability, religion, gender identity, sexuality, or ethnicity. Join a team where diversity is not just welcomed but celebrated as a key driver of growth and innovation.

What does hybrid working mean to us?

Hybrid working typically means 2 days in the office location listed on this advert and 3 days working at home each week. Some occasional travel to our other offices may be required.

What happens next?

Once we receive your application, it will be reviewed by a human - no bots here! The average process typically takes around 2-3 weeks, with 2 stages of video interviews using Teams. However, this can vary depending on the role. We may invite you for a face‑to‑face meeting or require only 1 video interview. If you have any questions or need support, our Recruitment Team is here to assist you.

We're committed to making the application process easy and comfortable. Let us know how we can help you with any reasonable adjustments that can be tailored to your needs. At the bottom of each of our adverts you can find one of our recruitment teams' contact details. Please reach out so we can discuss with you further.

Our privacy policy is here