Lead Data Engineer (Databricks) – Leeds

Noir Consulting; Leeds; On-site; GBP 55,000 - 70,000; Full time

Job summary

A leading technology recruitment firm seeks a Lead Data Engineer in Leeds. You'll lead an Agile engineering team, provide technical leadership, and build modern data platforms with cutting-edge technologies. Ideal candidates have strong experience in Python, PySpark, SQL, and Databricks, alongside a passion for Data Science and Machine Learning. This role offers competitive salary, excellent career progression, and a chance to work with a prestigious brand.

Benefits

Pension

Benefits

Career development opportunities

Qualifications

• Strong experience in Python, PySpark, and SQL.
• Clear understanding of Databricks.
• Passion for Data Science, R, Machine Learning, and AI.
• Database experience with SQL and No-SQL.
• Significant Agile and Scrum exposure with SOLID principles.
• Knowledge of Continuous Integration tools and strong Cloud Platform, ideally AWS.

Responsibilities

• Lead client delivery and ensure high standards.
• Work with architects and create automated tests.
• Instill a culture of continuous improvement.
• Build a greenfield modern data platform using cutting-edge technologies.
• Architect big data solutions and develop complex data ETL and ML pipelines.

Skills

Python

PySpark

SQL

Data Science

Machine Learning

Agile

Scrum

TDD

BDD

CI / CD

Infrastructure as Code

AWS

Tools

Databricks

Github

Azure DevOps

Terraform

AWS CDK

AWS CloudFormation

Aurora

MS SQL Server

MySQL

Job description

Lead Data Engineer (Databricks) - Leeds

(Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI / CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer)

Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run an exceptional Agile engineering team and provide technical leadership through coaching and mentorship.

We are seeking a Lead Data Engineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a greenfield modern data platform using cutting-edge technologies, architecting big data solutions and developing complex enterprise data ETL and ML pipelines and projections.

The successful candidate will have strong Python, PySpark and SQL experience, possess a clear understanding of databricks, as well as a passion for Data Science (R, Machine Learning and AI). Database experience with SQL and No-SQL - Aurora, MS SQL Server, MySQL is expected, as well as significant Agile and Scrum exposure along with SOLID principles. Continuous Integration tools, Infrastructure as code and strong Cloud Platform knowledge, ideally with AWS is also key.

We are keen to hear from talented Lead Data Engineer candidates from all backgrounds.

This is a truly amazing opportunity to work for a prestigious brand that will do wonders for your career. They invest heavily in training and career development with unlimited career progression for top performers.

Location: Leeds

Salary: £55k - £70k + Pension + Benefits

To apply for this position please send your CV to Nathan Warner at Noir Consulting.

(Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI / CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer)

NOIRUKTECHREC

NOIRUKREC