Lead Data Engineer: Azure and Databricks Platform Architect

IntelliAM AI Ltd; Sheffield; Hybrid; GBP 60,000 - 80,000; Full time

Benefits offered by this job

5 weeks paid annual leave

Tax efficient stock options

Workplace pension with employer contributions

Salary Sacrifice EV Scheme

Training and professional development opportunities

Job summary

A leading asset management firm based in Sheffield is seeking a full-time Technical Lead in Data Engineering. You will architect new data flows, rebuild data pipelines, and mentor a growing team. Key responsibilities include leading the redesign of the data transformation layer and establishing data serving layers for real-time analytics. Ideal candidates will have proven experience in Azure and Databricks. The role requires regular in-person attendance twice a week for collaboration, offering a competitive benefits package including 5 weeks of annual leave and training opportunities.

Qualifications

• Proven experience building data platforms on Azure.
• Strong opinions on schema design and data standardization.
• Experience in high-volume data systems is beneficial.

Responsibilities

• Lead the redesign and rebuild of the data transformation layer.
• Support implementation of the 'Unified Name Space' across the data estate.
• Establish a stable data serving layer for Grafana and Analytics.

Skills

Advanced Data Engineering

Data Modelling Proficiency

Code Quality

Communication

Tools

Azure

Databricks

Job description

A leading asset management firm based in Sheffield is seeking a full-time Technical Lead in Data Engineering. You will architect new data flows, rebuild data pipelines, and mentor a growing team. Key responsibilities include leading the redesign of the data transformation layer and establishing data serving layers for real-time analytics. Ideal candidates will have proven experience in Azure and Databricks. The role requires regular in-person attendance twice a week for collaboration, offering a competitive benefits package including 5 weeks of annual leave and training opportunities.