Lead Data Engineer (Databricks) - Leeds

ZipRecruiter; Leeds; On-site; GBP 55,000 - 70,000; Full time

Job summary

A leading technology company in Leeds is seeking a Lead Data Engineer to provide technical leadership and mentorship within an Agile engineering team. Candidates should possess significant experience in Databricks, Python, and SQL, along with a passion for Data Science. The role involves architecting big data solutions and developing complex ETL and ML pipelines. Competitive salary ranges from £55k to £70k plus benefits.

Benefits

Pension

Career development opportunities

Training investment

Qualifications

• Strong experience with Python, PySpark and SQL.
• Understanding of Databricks and passion for Data Science.
• Experience with SQL and No-SQL databases.

Responsibilities

• Lead client delivery, ensuring the highest standards.
• Create automated tests and set standards for the team.
• Architect big data solutions and develop ETL and ML pipelines.

Skills

Python

PySpark

SQL

Data Science

Machine Learning

AI

Agile methodologies

Scrum

SOLID principles

Tools

Databricks

Github

Azure DevOps

Terraform

AWS CloudFormation

Job description

Job Description

Lead Data Engineer (Databricks) - Leeds

(Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI / CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer)

Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run an exceptional Agile engineering team and provide technical leadership through coaching and mentorship.

We are seeking a Lead Data Engineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a greenfield modern data platform using cutting-edge technologies, architecting big data solutions and developing complex enterprise data ETL and ML pipelines and projections.

The successful candidate will have strong Python, PySpark and SQL experience, possess a clear understanding of databricks, as well as a passion for Data Science (R, Machine Learning and AI). Database experience with SQL and No-SQL - Aurora, MS SQL Server, MySQL is expected, as well as significant Agile and Scrum exposure along with SOLID principles. Continuous Integration tools, Infrastructure as code and strong Cloud Platform knowledge, ideally with AWS is also key.

We are keen to hear from talented Lead Data Engineer candidates from all backgrounds.

This is a truly amazing opportunity to work for a prestigious brand that will do wonders for your career. They invest heavily in training and career development with unlimited career progression for top performers.

Location: Leeds

Salary: £55k - £70k + Pension + Benefits

To apply for this position please send your CV to Nathan Warner at Noir Consulting.

(Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI / CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer)

NOIRUKTECHREC

NOIRUKREC