Lead Data Engineer (Databricks) - Leeds in Leeds

Energy Jobline ZR; Leeds; On-site; GBP 55,000 - 70,000; Full time

Job summary

A leading global energy job board is looking for a Lead Data Engineer to build a greenfield modern data platform in Leeds. The role demands significant Databricks experience and leadership capabilities to guide an Agile engineering team. Ideal candidates should have strong skills in Python, PySpark, and SQL, and a passion for Data Science including ML and AI. The salary offered is between £55k and £70k plus additional benefits.

Benefits

Pension

Benefits

Qualifications

• Significant experience with Databricks and leadership responsibility.
• Experience in architecting big data solutions and developing ETL/ML pipelines.
• Strong background in Agile methodologies and Scrum.

Responsibilities

• Build a greenfield modern data platform using cutting-edge technologies.
• Architect big data solutions and develop complex enterprise data ETL and ML pipelines.
• Lead Agile engineering team providing technical leadership and mentorship.

Skills

Python

PySpark

SQL

Continuous Integration tools

Infrastructure as Code

Cloud Platform knowledge (AWS)

Agile

GitHub

Azure DevOps

Jenkins

Terraform

AWS CDK

AWS CloudFormation

Job description

Energy Jobline is the largest and fastest growing global Energy Job Board and Energy Hub. We have an audience reach of over 7 million energy professionals, 400,000+ monthly advertised global energy and engineering jobs, and work with the leading energy companies worldwide.

We focus on the Oil & Gas, Renewables, Engineering, Power, and Nuclear markets as well as emerging technologies in EV, Battery, and Fusion. We are committed to ensuring that we offer the most exciting career opportunities from around the world for our jobseekers.

Job Description

Lead Data Engineer (Databricks) - Leeds

Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run an exceptional Agile engineering team and provide technical leadership through coaching and mentorship.

We are seeking a Lead Data Engineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a greenfield modern data platform using cutting‑edge technologies, architecting big data solutions and developing complex enterprise data ETL and ML pipelines and projections.

Responsibilities include:

• Building a greenfield modern data platform using cutting‑edge technologies.
• Architecting big data solutions and developing complex enterprise data ETL and ML pipelines and projections.
• Working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team.
• Leading Agile engineering team and providing technical leadership through coaching and mentorship.

Qualifications:

• Strong Python, PySpark and SQL experience.
• Clear understanding of Databricks and passion for Data Science (R, Machine Learning and AI).
• Database experience with SQL and No‑SQL (Aurora, MS SQL Server, MySQL).
• Significant Agile and Scrum exposure along with SOLID principles.
• Continuous Integration tools, Infrastructure as Code and strong Cloud Platform knowledge, ideally with AWS.
• Experience with GitHub, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation.

We are keen to hear from talented Lead Data Engineer candidates from all backgrounds.

Location: Leeds

Salary: £55k - £70k + Pension + Benefits

To apply for this position please send your CV to Nathan Warner at Noir Consulting.

Energy Jobline wishes you the very best of luck in your next career move.