Senior Data Engineer

My Agency; City Of London; Hybrid; GBP 75,000 - 90,000; Full time

Job summary

A leading recruitment agency is looking for a Senior Data Engineer to work on a greenfield data project for a top energy trading company. This role involves migrating legacy data systems to scalable solutions while utilizing technologies like Python and Docker. Ideal candidates will have experience in building data pipelines and knowledge of data storage solutions. The position offers competitive compensation based in London with flexible office attendance.

Qualifications

• Experience working with Python in building data pipelines.
• Knowledge of typical data storage solutions e.g. relational databases.

Responsibilities

• Work on a greenfield data project focusing on scalable solutions.
• Collaborate within a flat team structure to influence project direction.
• Transform data handling for informed trading decisions.

Skills

Building data pipelines with Python

Knowledge of data storage solutions

Tools

Python

Airflow

Great Expectations

Docker

Azure

Job description

Overview

Work on a greenfield data project for one of the world’s leading energy organisations, leveraging data points across energy sources to enable their trading team to make decisions & drive success.

We’re looking for a Senior Data Engineer to join a brand-new team in a leading Energy Trading Company, to take forward their migration from legacy data systems to create a future-proof data ingestion & storage solution focused on scalability.

This is a top-paying industry, and anyone joining at this stage would be positioning themselves for high remuneration in future.

This role is perfect for:

– Senior Data Engineers that want to work in one of the world’s rapidly expanding fields, the world of energy trading is a fascinating one, with all manner of unique technical challenges. This is not far removed from hedge funds and can be a difficult space to break into. This is an opportunity to do so and maximise your earning potential in the long run.

– Senior Data Engineers that want to work on a greenfield data project which will have a major impact within a top organisation in their field.

– Senior Data Engineers that want to expand their skillset in Artificial Intelligence & Machine Learning as applied to algorithmic trading in an environment where billions in currency are hinging on every trading decision.

For technology, they’re employing Python, Airflow, Great Expectations, and Docker – hosted in Azure.

Responsibilities

• Work on a greenfield data project in a leading Energy Trading Company, focusing on migration from legacy data systems to a scalable data ingestion & storage solution.
• Collaborate within a flat team structure to influence the direction of the project as it scales, working alongside other engineers.
• Transform how data is handled to enable the trading team to make informed decisions.

Qualifications

• Experience working with Python in building data pipelines.
• Knowledge of typical data storage solutions e.g. relational databases.

Technology & Environment

Technologies include Python, Airflow, Great Expectations, Docker, hosted in Azure.

Logistics

This role is London based, looking for two days per week in the office (flexible) and is paying up to 90k per annum.

If this role’s of interest, please apply now for more information.