Senior Data Engineer: Greenfield Data Pipelines (London)

My Agency; City Of London; Hybrid; GBP 75,000 - 90,000; Full time

Job summary

A leading recruitment agency is looking for a Senior Data Engineer to work on a greenfield data project for a top energy trading company. This role involves migrating legacy data systems to scalable solutions while utilizing technologies like Python and Docker. Ideal candidates will have experience in building data pipelines and knowledge of data storage solutions. The position offers competitive compensation based in London with flexible office attendance.

Qualifications

• Experience working with Python in building data pipelines.
• Knowledge of typical data storage solutions e.g. relational databases.

Responsibilities

• Work on a greenfield data project focusing on scalable solutions.
• Collaborate within a flat team structure to influence project direction.
• Transform data handling for informed trading decisions.

Skills

Building data pipelines with Python

Knowledge of data storage solutions

Tools

Python

Airflow

Great Expectations

Docker

Azure

Job description

A leading recruitment agency is looking for a Senior Data Engineer to work on a greenfield data project for a top energy trading company. This role involves migrating legacy data systems to scalable solutions while utilizing technologies like Python and Docker. Ideal candidates will have experience in building data pipelines and knowledge of data storage solutions. The position offers competitive compensation based in London with flexible office attendance.