Lead Data Engineer (Databricks) – Leeds

Noir Consulting; Leeds; On-site; GBP 100,000 - 125,000; Full time

Job summary

A leading technology consultancy in Leeds is seeking a skilled Lead Data Engineer to manage an Agile engineering team. The position requires extensive experience with Databricks, strong skills in Python and SQL, and a passion for data science. Join a prestigious brand known for investing in training and career development, offering unlimited growth potential for top performers.

Benefits

Career development opportunities

Training investment

Unlimited growth potential

Qualifications

• Extensive experience with Databricks.
• Strong understanding of Agile and Scrum methodologies.
• Familiarity with NoSQL databases.

Responsibilities

• Lead client delivery and manage an Agile engineering team.
• Create automated tests and architect big data solutions.
• Develop complex enterprise data ETL and ML pipelines.

Skills

Python

PySpark

SQL

Data Science

Tools

Databricks

AWS

SQL Server

MySQL

Job description

Social network you want to login/join with:

Lead Data Engineer (Databricks) – Leeds, Leeds

Client:

Location:

Leeds, United Kingdom

Job Category:

Other

EU work permit required:

Yes

Job Reference:

20e282bfe8d6

Job Views:

4

Posted:

01.08.2025

Expiry Date:

15.09.2025

Job Description:

Our client is a global innovator and world leader within technology, seeking a Lead Data Engineer with extensive Databricks experience and leadership skills to manage an Agile engineering team and provide technical guidance.

The role involves leading client delivery, setting high standards, working with architects, creating automated tests, and fostering a culture of continuous improvement. You will build a modern data platform using cutting-edge technologies, architect big data solutions, and develop complex enterprise data ETL and ML pipelines.

Requirements include strong Python, PySpark, and SQL skills, a good understanding of Databricks, and a passion for Data Science (R, Machine Learning, AI). Experience with SQL and NoSQL databases (e.g., Aurora, MS SQL Server, MySQL), Agile and Scrum methodologies, SOLID principles, CI tools, Infrastructure as Code, and cloud platforms (preferably AWS) are essential.

We welcome talented Lead Data Engineer candidates from diverse backgrounds. This is an excellent opportunity to work for a prestigious brand that invests heavily in training and career development, offering unlimited growth potential for top performers.