Senior Data Engineer - Databricks & Data Foundations

Eaglecliff; Greater London; On-site; GBP 90,000 - 130,000; Full time

Job summary

We are looking for a Senior Data Engineer to join Eaglecliff, a world-leading Energy Trading company, to design and build data foundations and end-to-end solutions for the Business to maximize value from data. The candidate is expected to be a subject matter expert who designs and builds data solutions while mentoring junior engineers.

They are a key driver in translating Vision and Data Strategy into IT solutions and delivering on them, with strong hands-on expertise in Databricks, PySpark,

Qualifications

• Strong hands-on expertise in Databricks, PySpark, Python and SQL is central to this role.
• Mentor junior engineers and translate Vision and Data Strategy into IT solutions and delivering on them.
• Presents reports and findings to key stakeholders and acts as the subject matter expert on Data Analysis & Design.

Responsibilities

• Design and build data foundations and end-to-end data solutions for the Business to maximize value from data.
• Mentor junior engineers and actively drive roll-out and embedding of Data Foundation initiatives.
• Coordinate change, incident and problem management processes and report to stakeholders.

Skills

Databricks

PySpark

Python

SQL

Data Modeling

Data Integration & Ingestion

Data Manipulation & Processing

GitHub

GitHub Actions

Azure DevOps

Tools

Azure Stack

Data Factory

Databricks

SQL DB

Synapse

Stream Analytics

Glue

Airflow

Kinesis

Redshift

SonarQube

PyTest

Job description

We are looking for a Senior Data Engineer to join Eaglecliff, a world-leading Energy Trading company, to design and build data foundations and end-to-end solutions for the Business to maximize value from data. The candidate is expected to be a subject matter expert who designs and builds data solutions while mentoring junior engineers.

They are a key driver in translating Vision and Data Strategy into IT solutions and delivering on them, with strong hands-on expertise in Databricks, PySpark,