Senior Data Engineer : Databricks

Eaglecliff Recruitment; Greater London; Hybrid; GBP 90,000 - 110,000; Full time

Job summary

Eaglecliff Recruitment seeks a Senior Data Engineer to design and build data foundations and end-to-end data solutions for a world-leading Energy Trading company.

You will mentor junior engineers, translate Vision and Data Strategy into IT solutions, and drive data foundation initiatives across key programs. Strong hands-on Databricks, PySpark, Python and SQL expertise is essential.

Qualifications

• Strong hands-on expertise in Databricks, PySpark, Python and SQL is central to this role.
• Mentor junior engineers and translate Vision and Data Strategy into IT solutions.
• Design and build data foundations and end-to-end data solutions.

Responsibilities

• Design and build data foundations and end-to-end data solutions to maximize value from data.
• Act as subject matter expert for Data Analysis & Design and mentor engineers.
• Lead roll-out and embedding of Data Foundation initiatives across key programs.

Skills

ELT Experience

Data Modeling

Data Integration & Ingestion

Data Manipulation and Processing

Tools

Databricks

PySpark

Python

SQL

Job description

We are looking for a Senior Data Engineer to join a world-leading Energy Trading company to design and build data foundations and end-to-end solutions for the Business to maximize value from data.

The candidate is expected to be a subject matter expert who designs and builds data solutions while also mentoring junior engineers. They are also a key driver in translating Vision and Data Strategy into IT solutions and delivering on them.

Strong hands-on expertise in Databricks, PySpark, Python and SQL is central to this role.

Key Skills:

• ELT Experience
• Data Modeling
• Data Integration & Ingestion
• Data Manipulation and Processing

Key Characteristics:

• Technology expert who constantly pursues knowledge enhancement and has an inherent curiosity to understand work from multiple dimensions.
• Deep data focus with expertise across relevant technology domains.
• A skilled communicator capable of engaging both technical developers and business managers; respected and trusted by leaders and staff.
• Actively delivers the roll-out and embedding of Data Foundation initiatives in support of key business programs.
• Coordinates the change management, incident management, and problem management processes.
• Presents reports and findings to key stakeholders and acts as the subject matter expert on Data Analysis & Design.
• Drives implementation efficiency and effectiveness across pilots and future projects to minimize cost, increase speed of delivery, and maximize value.
• Contributes to community-building initiatives such as Centers of Excellence (CoE) and Communities of Practice (CoP)

Hybrid: London, Waterloo + Remote - In Office 3 Days Per Week

Rate: Competitive PAYE