Data Engineering Lead: Databricks Platform Transformation

Unite Students; West of England; On-site; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Discretionary annual bonus

25 days' holiday + buy scheme

Pension scheme (employer contributions

Health & wellbeing benefits

Employee Assistance Programme

Wellbeing platform

Gym benefit for you and family

Enhanced Family Leave

Job summary

Unite Students is seeking an experienced Data Engineering Lead to shape and grow our Data & Insight capabilities. You will lead and mentor a team of Data Engineers, provide technical direction, and stay hands-on with complex challenges, including evolving our Databricks data platform.

You will shape data strategy, drive transformation programmes, and collaborate with BI, Data Science, Architecture and business teams to deliver trusted data solutions that support business growth.

Qualifications

• Proven experience leading Data Engineering teams in complex enterprise environments.
• Strong SQL and Python skills with extensive experience in Databricks, Spark and lakehouse architectures.
• Ability to balance strategic leadership with hands-on technical delivery.
• Excellent communication and stakeholder management skills.
• Experience delivering data solutions for analytics, reporting and data science.
• Experience working in Agile environments.

Responsibilities

• Provide technical leadership for scalable, reliable and secure data platforms and products.
• Lead, mentor and develop a team of Data Engineers, promoting collaboration and technical excellence.
• Ensure the stability, performance and continuous improvement of critical data platforms and pipelines.
• Lead the migration from our existing data warehouse to Databricks.
• Support major transformation programmes, including SaaS migration and wider business integration initiatives.
• Design and maintain data pipelines, models and curated datasets for analytics, reporting and data science.
• Collaborate with BI, Data Science, Architecture, Technology and business teams to deliver trusted data solutions.
• Champion engineering best practices, including testing, deployment, monitoring, documentation and code reviews.
• Support Agile delivery, from prioritisation and sprint planning through to delivery.
• Identify opportunities to improve our data platforms, tooling and ways of working.

Skills

Leadership

SQL

Python

Databricks

Spark

Stakeholder management

Agile

Tools

Databricks

Spark

Tableau

SnapLogic

Job description

Unite Students is seeking an experienced Data Engineering Lead to shape and grow our Data & Insight capabilities. You will lead and mentor a team of Data Engineers, provide technical direction, and stay hands-on with complex challenges, including evolving our Databricks data platform.

You will shape data strategy, drive transformation programmes, and collaborate with BI, Data Science, Architecture and business teams to deliver trusted data solutions that support business growth.