Data Engineer

SmartestEnergy; Greater London; Hybrid; GBP 38,000 - 60,000; Full time

Benefits offered by this job

Flexible working

Global offices UK/US/Australia

Job summary

SmartestEnergy is looking for a junior data engineer to support the development and maintenance of enterprise data solutions including Data Lakehouse, Data Warehouse and Medallion Architecture. You will work with senior engineers to build, test and deploy scalable data pipelines using Azure Data Factory, Synapse and Fabric, with mentorship.

You will gain hands-on experience across ingestion, validation, transformations, data quality, and BI integration as part of a learning-focused team that

Qualifications

• Experience delivering data pipelines and basic data integration.

Responsibilities

• Support data integration and ETL development across the data platform.
• Develop and maintain metadata-driven notebooks in Fabric.

Skills

Sprint delivery

Data pipeline reliability

Data latency

Business insight delivery

Fabric AI & automation

Bug reduction

Tools

Microsoft Fabric

Azure Data Factory

Azure Synapse

Power BI

Azure DevOps

Git

Job description

The purpose of this role is to support the development and maintenance of enterprise data solutions including the Data Lakehouse, Data Warehouse, and Medallion Architecture. This role will work alongside senior engineers and architects to build, test, and deploy scalable data pipelines, with a focus on tasks such as ingestion, data validation, and structured transformations.

The role is a hands‑on opportunity for someone early in their data engineering career to gain deep experience with Microsoft’s Azure Data Platform and Microsoft Fabric, working on real‑world solutions under guidance and mentorship.

What will I spend my time in this role?

• Data Integration Support
• ETL Development
• Notebook Automation Support
• Data Quality and Testing
• Documentation and Data Catalogue Support
• BI & Reporting Integration
• Environment & DevOps Support
• Learning and Development
• Testing and Data Quality Assurance

Assist with building and maintaining data ingestion pipelines from various sources using tools like Microsoft Fabric, Azure Data Factory and Synapse pipelines.

Develop and maintain reusable ETL processes, supporting the all layers of the Medallion Architecture, with a focus on reliability, reusability, and simplicity.

Help implement and schedule metadata-driven notebooks in Fabric working with Spark under the supervision of senior engineers.

Assist in implementing and monitoring data quality checks, validation rules, and basic lineage tracking.

Document data flows, transformations, and support updates to data cataloguing tools or metadata repositories.

Assist with connecting data models to Power BI, and help develop certified datasets and semantic layers for self‑service users.

Learn and contribute to CI/CD processes using Azure DevOps and Git. Support code reviews and testing cycles.

Be an active participant in code reviews, design sessions, and platform learning. Take ownership of tasks and work through feedback constructively.

Develop and maintain unit tests to validate pipeline logic and data transformations. Collaborate with engineering peers to continuously refine test coverage and uphold data integrity standards.

What skills/experience do I need to be successful?

• Successful delivery of sprints to the satisfaction of stakeholders.
• Data Pipeline Reliability-Pipelines run with minimal failures and auto‑recovery
• Data Latency - Freshness meets defined SLAs for Bronze, Silver, Gold layers
• Valuable insight into the business is delivered through the implementation of new solutions.
• Innovation -Regular adoption of new Fabric AI and automation features
• Implement Robust solutions with minimal time spent fixing bugs.

What sets us apart?

• Global Impact: With offices in the UK, US, and Australia, and plans for further expansion, you'll be part of a dynamic, globally‑minded team, with opportunities to explore new markets and make a difference on a global scale.
• Flexible Working: Embrace the freedom to work from anywhere in the world for up to 30 days a year. We prioritize work‑life balance, recognizing that your well‑being matters. Find out more here.
• Commitment to Diversity and Inclusion: We celebrate our diverse culture and value individuals irrespective of background, disability, religion, gender identity, sexuality, or ethnicity. Join a team where diversity is not just welcomed but celebrated as a key driver of growth and innovation.

What does hybrid working mean to us?

Hybrid working typically means 2 days in the office location listed on this advert and 3 days working at home each week. Some occasional travel to our other offices may be required.

What happens next?

Once we receive your application, it will be reviewed by a human – no bots here! The average process typically takes around 2‑3 weeks, with 2 stages of video interviews using Teams. However, this can vary depending on the role. We may invite you for a face‑to‑face meeting or require only 1 video interview. If you have any questions or need support, our Recruitment Team is here to assist you.

Ready to join us on our journey to digitise, decarbonise, and localise the future of energy?

We're committed to making the application process easy and comfortable. Let us know how we can help you with any reasonable adjustments that can be tailored to your needs. At the bottom of each of our adverts you can find one of our recruitment teams' contact details. Please reach out so we can discuss with you further.

Check out all our current open positions

Our privacy policy is here