Lead Data Engineer: Databricks Modernisation (Hybrid)

Energy Jobline ZR; Hexham; Hybrid; GBP 72,000 - 88,000; Full time

Benefits offered by this job

Salary up to £80k

Hybrid work in Newcastle

Career progression

Exposure to cloud data tech

Collaborative environment

Job summary

Energy Jobline ZR is seeking a Lead Data Engineer to drive a major data transformation, migrating from on‑premise systems to a Databricks‑based architecture. You will lead a team of engineers and analysts, delivering scalable data products that enable insight and decision‑making.

The role focuses on designing and building data pipelines, mentoring staff, and partnering with stakeholders to deliver robust data solutions while advancing the company’s data capabilities in a hybrid Newcastle

Qualifications

• Experience leading data engineering teams or mentoring junior engineers.
• Hands-on Databricks implementation and data platform migrations.
• Strong SQL and data modeling capabilities.
• Proven ability to design and maintain ETL/ELT pipelines.
• Knowledge of Azure data services is a plus.
• Excellent stakeholder communication and collaboration.

Responsibilities

• Lead migration of on-prem data platforms to Databricks.
• Design, build and optimize scalable data pipelines and integrations.
• Drive best practices in data engineering, architecture and governance.
• Mentor engineers and analysts within the team.
• Collaborate with stakeholders to gather requirements and deliver solutions.
• Improve platform performance, reliability and scalability.
• Contribute to long-term data strategy and roadmap.

Skills

Leadership & mentoring

Databricks

SQL

ETL/ELT pipelines

Azure

Communication

Job description

Energy Jobline ZR is seeking a Lead Data Engineer to drive a major data transformation, migrating from on‑premise systems to a Databricks‑based architecture. You will lead a team of engineers and analysts, delivering scalable data products that enable insight and decision‑making.

The role focuses on designing and building data pipelines, mentoring staff, and partnering with stakeholders to deliver robust data solutions while advancing the company’s data capabilities in a hybrid Newcastle