Data Engineering Lead

ADLIB; West of England; Hybrid; GBP 111,000 - 120,000; Part time

Job summary

ADLIB is seeking an experienced Data Engineering Lead to join Bristol on a 3-5 month contract. You will lead the Databricks migration, design scalable data pipelines and mentor engineers while delivering hands-on technical work.

You'll work with Databricks, Spark, Python and SQL to modernise the data platform, partnering with data scientists and stakeholders to ensure reliable, high-performance solutions in a hybrid Bristol-based team.

Qualifications

• Excellent experience with Databricks.
• Spark experience.
• Strong SQL and Python skills.
• Experience building modern cloud-based data platforms.
• Strong understanding of data modelling and engineering best practices.
• Experience delivering migration, modernisation or transformation projects.
• Comfortable providing technical leadership and mentoring engineers.
• Experience working in Agile environments.

Responsibilities

• Lead the Databricks migration and data platform transformation.
• Design, build and optimise scalable data solutions.
• Mentor and support engineers while delivering technical leadership.
• Collaborate with Data Engineers, Data Scientists and stakeholders to deliver reliable data platforms.

Skills

Databricks

Spark

SQL

Python

Cloud data platforms

Data modelling

Engineering best practices

Migration/Transformation

Agile

Job description

• Outside IR35 - 3-5 month contract - 2-3 days per week in Bristol
• Lead the technical delivery of a Databricks migration and wider data platform transformation
• Hands-on role focused on Databricks, Spark, Python and SQL, with some mentoring responsibilities

We're looking for an experienced Data Engineering Lead to join a Bristol-based organisation during a major data transformation programme.

What you'll be doing

This is a hands-on contract focused on helping deliver a migration to Databricks, improving data engineering practices and supporting the wider evolution of the data platform. You'll work closely with Data Engineers, Data Scientists and technical stakeholders to design, build and optimise scalable data solutions.

While there will be opportunities to mentor and support engineers, this role is primarily focused on technical leadership and delivery during this interim role. You'll help drive the Databricks migration, build and optimise data pipelines, improve platform performance and establish engineering best practices across the team.

Working closely with stakeholders across technology and the business, you'll play a key role in delivering reliable, scalable data solutions and supporting wider transformation initiatives.

What experience you'll need

• Excellent experience with Databricks
• Spark experience
• Strong SQL and Python skills
• Experience building modern cloud-based data platforms
• Strong understanding of data modelling and engineering best practices
• Experience delivering migration, modernisation or transformation projects
• Comfortable providing technical leadership and mentoring engineers
• Experience working in Agile environments

The Details

This is an initial 3-5 month contract paying £600-650 per day, operating Outside IR35. The team works on a hybrid basis with 2-3 days per week in the Bristol office, close to Temple Meads.