Databricks Data Engineer | Energy Trading

ZipRecruiter; London; On-site; GBP 70,000 - 100,000; Full time

Job summary

A leading company in the UK seeks a Senior Databricks Data Engineer to modernize their data infrastructure. The role spans data architecture and engineering, focusing on delivering cloud-first solutions in a global trading environment. Ideal candidates will possess extensive experience with cloud platforms and data technologies.

Qualifications

• Experience with cloud platforms including AWS, Azure, or SAP.
• Proficient in ETL/ELT development and data manipulation.
• Skills in version control and DevOps practices.

Responsibilities

• Design and build scalable data solutions to support a data-driven business.
• Champion data foundation initiatives and mentor junior engineers.
• Deliver data-driven insights and coordinate data project efficiencies.

Skills

ETL/ELT Development

Data Modeling

Data Integration & Ingestion

Data Manipulation & Processing

Version Control & DevOps

Tools

Azure Data Factory

Databricks

SQL DB

Synapse

Stream Analytics

AWS

Azure

SAP

Glue

Airflow

Kinesis

Redshift

SonarQube

PyTest

Job description

Job Description

Senior Databricks Data Engineer | Energy Trading - Contract

My client is an Energy Trading Client based in the UK who are looking to appoint a Senior Databricks Data Engineer to help modernise their data infrastructure and deliver end-to-end solutions that drive business value. This is a high-impact role working across data strategy, architecture, and engineering to deliver cloud-first solutions within a global trading environment.

Role:

Key Responsibilities:

• Design and build data foundations and scalable solutions to support the business in becoming data-driven.
• Champion and implement Data Foundation initiatives in line with strategic programmes.
• Translate vision and data strategy into practical, high-value engineering solutions.
• Serve as a subject matter expert, mentoring junior engineers and collaborating with business and technical stakeholders.
• Coordinate incident, problem, and change management processes.
• Present data-driven insights and architectural decisions to senior stakeholders.
• Drive efficiency across data projects to improve speed, reduce cost, and maximize value.
• Contribute to internal communities of excellence and practice (CoE, CoP).

Skills Needed:

• Experience with cloud platforms including, AWS, Azure or SAP
• ETL/ELT Development
• Data Modeling
• Data Integration & Ingestion
• Data Manipulation & Processing
• Version Control & DevOps: Skilled in GitHub, GitHub Actions, Azure DevOps
• Azure Data Factory, Databricks, SQL DB, Synapse, Stream Analytics
• Glue, Airflow, Kinesis, Redshift
• SonarQube, PyTest

If you're ready to take on a new challenge and shape data engineering in a trading-first environment, submit your CV today to be considered.