Senior Data Engineer

EDF

Greater London

Hybrid

GBP 90,000 - 130,000

Full time

10 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

EDF Trading is seeking a hands-on Senior Data Engineer to accelerate value from high‑value data products. You will apply strong Python fundamentals, work with orchestration tools, and build real-time visualisations for front office stakeholders.

You will collaborate with traders, risk and management, design schemas, and contribute to data platforms using Plotly Dash/Streamlit, Docker, Kubernetes, and Azure DevOps in a hybrid office setup.

Qualifications

  • Strong Python and SQL experience with hands-on engineering practice.
  • Experience building data pipelines and data models for real-time use cases.
  • Proficient in designing database schemas and ORM models (SQLAlchemy).
  • Experience with data orchestration tools and CI/CD pipelines.
  • Familiarity with Python UI dashboards (Plotly Dash/Streamlit).
  • Strong communication with business and technical stakeholders.

Responsibilities

  • Build and maintain data pipelines integrating with trading workflows and processes.
  • Embed data quality controls and monitoring with incident support.
  • Translate business needs into technical tasks and deliver data products.
  • Contribute to architectural decisions for pipelines and systems.
  • Design schemas and ORM models to support data governance.
  • Develop real-time visualisations using streaming tech.
  • Create dashboards with Python UI tools and ensure observability.
  • Tune SQL queries for performance and collaborate on DevOps practices.
  • Own work end-to-end, prioritise, plan, and manage risks.

Skills

Python
SQL
Data pipelines
Data visualization
Communication
CI/CD

Tools

Airflow
Dagster
Prefect
Azure DevOps
Docker
Kubernetes
Plotly Dash
Streamlit

Job description

When you join EDF Trading, you'll become part of a diverse international team of experts who challenge conventional ideas, test new approaches, and think outside the box. Energy markets evolve rapidly, so our team needs to remain agile, flexible, and ready to spot opportunities across all the markets we trade in power, gas, LNG, LPG, oil, and environmental products. EDF Group and our customers all over the world trust that their assets are managed by us in the most effective and efficient manner and are protected through expert risk management. Trading for over 20 years, it's experience that makes us leaders in the field. Energy is what we do. Become part of the team and you will be offered a great range of benefits, which include (location dependent) hybrid working, a personal pension plan, private medical and dental insurance, bi-annual health assessments, corporate gym memberships, an electric car lease programme, childcare vouchers, a cycle-to-work scheme, season ticket loans, volunteering opportunities, and much more. Gender balance and inclusion are very high on the agenda at EDF Trading, so you will become part of an ever-diversifying family of around 750 colleagues based in London, Paris, Singapore, and Houston. Regular social and networking events, both physical and virtual, will ensure that you always feel connected to your colleagues and the business. Who are we? We are EDF Trading, part of the EDF Group - a world leader in low-carbon, sustainable electricity generation. Join us, make a difference, and help shape the future of energy.

Job Description:
Department:

Front Office Data Products The Front Office Data Products team serves a variety of stakeholders across the Front Office, including traders, risk and senior management. We work with lots of different internal and external data sources, building and maintaining data pipelines, data models, and data products to support trading decisions and critical business processes. The team is currently expanding its capabilities to support real-time use cases alongside existing batch processing workflows, and is also expanding its Python data visualisation capabilities.

Position purpose

We are looking for a hands-on Senior Data Engineer to join our team to accelerate the delivery of high-value data products to the business. This person will be someone with strong Python fundamentals, experience with orchestration tools and Python data visualisation/UI tooling (ideally Plotly Dash) and will be someone who can communicate effectively with both business stakeholders and technical colleagues.

Main responsibilities
  • Build and maintain data pipelines that integrate with existing trading workflows and business processes, including operational ownership (monitoring, alerting, incident support) and embedding data quality controls (validation, anomaly detection).
  • Collaborate with stakeholders across different teams within the front office to understand requirements, translate business needs into technical tasks, and deliver high-quality data products. Explain trade-offs clearly and align on practical delivery plans.
  • Contribute to architectural decisions on how to implement pipelines and systems
  • Design database schemas and SQLAlchemy ORM models to support our data needs and cater for data quality and data governance requirements.
  • Utilise streaming technologies and event-driven architecture to build real-time visualisations
  • Develop dashboards and data products using Python UI tools (Plotly Dash, Streamlit or similar)
  • Participate in peer reviews and uphold engineering standards across the team (coding conventions, testing, CI/CD, observability, security-by-design).
  • Tune and optimise SQL queries for performance
  • Work with DevOps processes (Azure DevOps, CI/CD pipelines, Docker, Kubernetes)
  • Take ownership of work end-to-end: prioritise effectively, communicate with stakeholders, plan out the work, manage risks and dependencies, and drive tasks through to completion.
  • Be a role model for Python (and data engineering) best practices in the team
Experience and technical requirements
Essential
  • Strong Python and SQL experience
  • Data orchestration tools (Airflow, Dagster, Prefect)
  • Designing database schemas and ORM models (e.g. SQLAlchemy)
  • SQL query performance tuning and optimisation
  • Python UI/dashboard tools (Plotly Dash, Streamlit or similar)
  • DevOps experience (CI/CD pipelines, Azure DevOps or similar)
  • Strong communication skills – ability to work with both technical colleagues and business stakeholders.
Strongly Preferred
  • Kafka or other streaming technologies (e.g. Azure Event Hubs)
  • Kubernetes
  • Docker and containerisation
  • Azure Cloud services (Blob Storage, Application Insights, KeyVault, Azure DevOps)
  • Commodities trading or financial services background
Nice to have
  • Dagster
  • Tableau experience
Hours of work:

40 hours per week (Mon-Fri 08:30 - 17:30) Hybrid (min 3 days per week at the office)

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

EDF Trading • Greater London

Hybrid
GBP 90,000 - 120,000
Hybrid working
Personal pension plan
Private medical and dental insurance
+7
Junior Data Engineer
Junior Data Engineer

EDF Trading • Greater London

Hybrid
GBP 45,000 - 70,000
Hybrid working
Personal pension plan
Private medical and dental insurance
+6
Head of Data Platform
Head of Data Platform

EDF Trading North America, LLC • Greater London

Hybrid
GBP 120,000 - 180,000
Hybrid working
Pension plan
Private medical insurance
+8
Head of Data Platform
Head of Data Platform

EDF Trading Limited • Greater London

Hybrid
GBP 150,000 - 190,000
Personal pension plan
Private medical and dental insurance
Bi-annual health assessments
+7
Senior Data Engineer
Senior Data Engineer

E1 Edf Trading Ltd • England

Hybrid
GBP 90,000 - 130,000
Junior Data Engineer
Junior Data Engineer

E1 Edf Trading Ltd • Greater London

Hybrid
GBP 40,000 - 64,000
Senior.Net Developer
Senior.Net Developer

EDF • Greater London

Hybrid
GBP 75,000 - 110,000
Hybrid working
Personal pension plan
Private medical & dental insurance
+7
Head Of Data Platform
Head Of Data Platform

E1 Edf Trading Ltd • England

On-site
GBP 120,000 - 180,000
Principal Quantitative Engineer
Principal Quantitative Engineer

EDF Trading Limited • United Kingdom

Hybrid
GBP 120,000 - 190,000
Quantitative Engineer
Quantitative Engineer

EDF Trading • Greater London

Hybrid
GBP 85,000 - 120,000
Hybrid work environment
Personal pension plan
Private medical and dental insurance
+7