Senior Data Engineer

EDF Trading; Greater London; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A leading energy trading firm in the Greater London area is seeking a data engineer to design and manage robust data pipelines, ensuring data governance and quality. The role involves collaboration with traders, analysts, and product teams to deliver high-quality data products that meet user needs. Candidates should have strong experience with ETL/ELT, data modelling, and relevant programming languages such as Python and SQL. This position offers a hybrid working arrangement and requires strong communication and stakeholder engagement skills.

Qualifications

• Strong experience in data engineering including ETL/ELT, data modelling, and programming languages.
• Experience with data catalogues and metadata management.
• Proficiency in data quality controls within data pipelines.

Responsibilities

• Design and operate robust data pipelines and models embedding governance.
• Collaborate with teams to create governed data products that meet business needs.
• Develop and manage data catalogue and metadata processes.

Skills

ETL / ELT

Data modelling

Python

SQL

Alteryx

Data visualisation tools

Stakeholder engagement

Tools

Power BI

Tableau

Collibra

Azure

Databricks

MSSQL

Kafka

Job description

Description

Data is Energy

EDF Trading is a data business. Trading is transitioning into a data driven business. High quality data and the agility of the analysis are becoming the differentiator. EDF Trading has a leading footprint in the European energy markets and wants to monetise and optimise data as an asset.

The European energy space is complex and has a huge appetite for data. Power production from renewables in response to weather, capacity limitations across borders, storage optimisation modelling... these are just some of the complex data opportunities we trade on every day.

We’re looking for talented people who share our passion for data to join our team and seize these opportunities with us.

Team / department

The Data Management team is part of the Data Team which works closely with the Front Office and is the centre of data management, data quality and control and it has direct responsibility over the development and maintenance of EDF Trading’s datasets.

Main responsibilities

This role bridges handson data engineering with data governance. You will design and operate robust data pipelines and models with a focus on embedding governance by design - capturing metadata and lineage, enforcing access controls and data quality, and ensuring our catalogue and stewardship model reflect the reality of how data flows across EDF Trading.

You will collaborate with traders, analysts, and product teams to translate business needs into governed data products that are high quality, discoverable, and meet the needs of its users.

Support the establishment and management of data products by identifying critical data, gathering and documenting data requirements, and embedding data risk and control management within dataflows.

Develop and maintain the data catalogue and metadata management processes, ensuring automated population and enrichment of metadata from data pipelines and models.

Implement and monitor data quality controls within data engineering solutions, including data quality checks and issue management processes.

Collaborate with data owners, stewards, and business teams to ensure data assets are trusted, well-documented, and fit for purpose.

Develop and document standards, procedures, and operational controls for data management, ensuring these are reflected in technical solutions and engineering practices.

Provide advice and support to projects and business stakeholders on data governance best practices, including secure data access, data modelling, and data lifecycle management.

Prepare and present technical and governance content at data governance forums (e.g., Data Management Committee, Data Issue Management Forums).

Required Skills and Experience

Strong experience in data engineering : ETL / ELT, data modelling, and data analytics and programming languages (e.g., Python, SQL, Alteryx).

Experience with data catalogues (e.g. Collibra, Alation) and / or metadata management generally.

Experience with data analysis and data modelling (hands-on experience with conceptual, logical and physical data models)

Experience implementing data quality controls and issue management processes within data pipelines.

Experience with data visualisation tools (Power BI, Tableau).

Strong stakeholder engagement skills, including running workshops and presenting to business users.

Desirable Skills and Experience

Solid understanding of data governance concepts : metadata management, data ownership / stewardship, data quality, data security, and data architecture.

Experience in the energy trading sector or similarly data-rich environments.

Experience with data platforms and tools (e.g., Azure, Databricks, MSSQL, Kafka).

Hands-on experience developing conceptual, logical, and physical data models.

Interest in the latest technologies and automation, with a curiosity to research and innovate.

Person Specification

Taking ownership of any issues that come up and facilitates their resolution quickly using their own initiative while managing expectations

Ability to multitask, switch focus and prioritise own tasks

Interest in energy trading and willingness to work across the business on understanding the needs of different teams

Strong communication and interpersonal skills

Ability to fully participate in a multi-faceted team environment

Hours of work :

8.30am – 5.30pm Monday to Friday

Hybrid working arrangement