Senior Data Engineer - Real-Time Trading Data (Hybrid)

EDF Trading Limited; Greater London; Hybrid; GBP 90,000 - 120,000; Full time

Benefits offered by this job

Hybrid working

Personal pension plan

Private medical and dental insurance

Bi-annual health assessments

Corporate gym memberships

Electric car lease programme

Childcare vouchers

Cycle‑to‑work scheme

Season ticket loans

Volunteering opportunities

Job summary

EDF Trading Limited in London is seeking a hands‑on Senior Data Engineer to accelerate delivery of high‑value data products. You will work with Python, SQL and data‑oriented tooling to build pipelines feeding trading decisions and dashboards.

The role emphasizes real‑time data visualisations, strong collaboration with front‑office stakeholders, and involvement in DevOps practices within a hybrid work setup.

Qualifications

• Strong Python and SQL experience.
• Data orchestration tools (Airflow, Dagster, Prefect).
• Designing database schemas and ORM models (e.g. SQLAlchemy).
• SQL query performance tuning and optimisation.
• Python UI/dashboard tools (Plotly Dash, Streamlit or similar).
• DevOps experience (CI/CD pipelines, Azure DevOps or similar).
• Strong communication skills – ability to work with both technical colleagues and business stakeholders.

Responsibilities

• Build and maintain data pipelines that integrate with existing trading workflows and business processes, including monitoring, alerting, incident support, and data quality controls.
• Collaborate with stakeholders across different teams within the front office to translate business needs into technical tasks and deliver high‑quality data products.
• Contribute to architectural decisions on how to implement pipelines and systems.
• Design database schemas and ORM models to support data needs and governance requirements.
• Utilise streaming technologies and event driven architecture to build real time visualisations.
• Develop dashboards and data products using Python UI tools (Plotly Dash, Streamlit or similar).
• Participate in peer reviews and uphold engineering standards (CI/CD, observability, security‑by‑design).
• Tune and optimise SQL queries for performance.
• Work with DevOps processes (Azure DevOps, CI/CD pipelines, Docker, Kubernetes).
• Take ownership end‑to‑end: plan, communicate, manage risks and deliver tasks.

Skills

Python

SQL

Communication

Data orchestration

SQLAlchemy

UI dashboards

CI/CD

Docker/Kubernetes

Tools

Airflow

Dagster

Prefect

Plotly Dash

Streamlit

Azure DevOps

Docker

Kubernetes

Azure Cloud services

Job description

EDF Trading Limited in London is seeking a hands‑on Senior Data Engineer to accelerate delivery of high‑value data products. You will work with Python, SQL and data‑oriented tooling to build pipelines feeding trading decisions and dashboards.

The role emphasizes real‑time data visualisations, strong collaboration with front‑office stakeholders, and involvement in DevOps practices within a hybrid work setup.