Lead Data Engineer

ZipRecruiter; Warwick; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A leading recruitment platform is looking for a skilled Lead Data Engineer to enhance their Data & Insights platform using Azure stack. This hybrid role involves hands-on engineering, technical leadership, and managing DevOps practices. The ideal candidate has extensive experience with Databricks and Azure DevOps. Competitive pay from £700 per day on a fixed-term contract for 6 months.

Qualifications

• Extensive hands-on experience with Databricks.
• Strong background in Synapse and Azure DevOps.
• Proficiency in SQL and PySpark within a Databricks environment.
• Proven experience leading small engineering teams.
• Skilled in configuration management and technical documentation.

Responsibilities

• Lead and deliver hands-on data engineering across all layers of the Azure-based data platform.
• Act as the Databricks SME, overseeing architecture, configuration, and documentation.
• Guide and support the engineering team while contributing directly to development efforts.
• Manage DevOps practices including branch supervision and merging.
• Promote data pipelines and notebooks through development, testing, and production environments.
• Enhance monitoring and control frameworks to ensure platform reliability.
• Provide technical leadership and mentorship to a small team of Data Engineers.

Skills

Databricks

SQL

PySpark

Azure DevOps

Configuration management

Job description

Overview

Job Title: Lead Data Engineer

Location: Warwick (Hybrid - once per week onsite)

Remuneration: From £700 per day (via umbrella company)

Contract Details: Fixed Term Contract, 6 months, Full Time

Are you ready to take the lead in transforming data engineering? Our client, a forward-thinking organisation, is seeking a highly skilled and hands-on Lead Data Engineer to drive their Data & Insights platform built on the Azure stack. This is a Databricks-heavy role, ideal for someone who thrives in technical environments and enjoys working directly with cutting-edge tools.

Responsibilities

• Lead and deliver hands-on data engineering across all layers of the Azure-based data platform.
• Act as the Databricks SME (Subject Matter Expert), overseeing architecture, configuration, and documentation.
• Guide and support the engineering team while contributing directly to development efforts.
• Manage DevOps practices including branch supervision and merging.
• Promote data pipelines and notebooks through development, testing, and production environments.
• Enhance monitoring and control frameworks to ensure platform reliability.
• Provide technical leadership and mentorship to a small team of Data Engineers.

Essential Skills & Qualifications

• Extensive hands-on experience with Databricks - this is the core of the role.
• Strong background in Synapse and Azure DevOps.
• Proficiency in SQL and PySpark within a Databricks environment.
• Proven experience leading small engineering teams.
• Skilled in configuration management and technical documentation.

About Pontoon

Pontoon is an employment consultancy.

Equality, Inclusion & Reasonable Adjustments

We put expertise, energy, and enthusiasm into improving everyone\'s chance of being part of the workplace. We respect and appreciate people of all ethnicities, beliefs, orientations, identities, and more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive.

If you require reasonable adjustments at any stage, please let us know and we will be happy to support you.