Data Engineering Lead: Databricks Platform & Team Leadership

Unite Foundation; West of England; Hybrid; GBP 90,000 - 120,000; Full time

Benefits offered by this job

Discretionary annual bonus

25 days paid holiday

Generous pension scheme

Healthcare & wellbeing benefits

Life Assurance

Job summary

Unite Students is seeking an experienced Data Engineering Lead to join our Data & Insight team and shape the future of our data capabilities.

You'll lead and develop a team of Data Engineers, provide technical direction while remaining hands-on with complex engineering challenges, including the evolution of our Databricks data platform and data pipelines that support analytics, reporting and data science.

Qualifications

• Proven leadership of Data Engineering teams in large enterprises.
• Extensive hands-on experience with cloud-based data platforms.
• Strong SQL and Python skills, with Databricks and Spark know-how.
• Experience delivering data solutions for analytics and data science.

Responsibilities

• Provide technical leadership for scalable, reliable data platforms.
• Lead and develop a team of Data Engineers with coaching and collaboration.
• Ensure stability and performance of data pipelines and platforms.
• Lead migration from existing data warehouse to Databricks.
• Support major transformation programmes including SaaS migration.
• Design and maintain data pipelines, models and curated datasets for analytics.
• Collaborate with BI, Data Science, Architecture, Technology and business teams.
• Champion engineering best practices, testing, deployment and code reviews.

Skills

Data engineering leadership

Cloud data platforms

SQL

Python

Databricks

Spark

Stakeholder management

Agile delivery

Tools

Databricks

Spark

Tableau

SnapLogic

Job description

Unite Students is seeking an experienced Data Engineering Lead to join our Data & Insight team and shape the future of our data capabilities.

You'll lead and develop a team of Data Engineers, provide technical direction while remaining hands-on with complex engineering challenges, including the evolution of our Databricks data platform and data pipelines that support analytics, reporting and data science.