Senior Data Engineer & Lakehouse Architect (Hybrid)

Vermelo RPO; Manchester; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Annual leave 25 days

Yearly bonus

Private Medical Insurance

Life Assurance 4x annual salary

Hybrid Working

Modern, vibrant offices

Job summary

Markerstudy Group Services Limited is seeking a Principal Data Engineer to act as the senior technical authority for the Databricks Lakehouse platform. You will define engineering standards, architecture, and best practices while leading the design and delivery of scalable, secure data products using Databricks, Delta Lake, Unity Catalog and Azure Data Services.

The role requires strong leadership across squads, governance, and resilience, with a focus on end-to-end data product delivery and

Qualifications

• Extensive Data Engineering experience within enterprise-scale data environments.
• Hands-on experience delivering solutions using Databricks.
• Experience designing and implementing Lakehouse architectures.
• Strong commercial experience using PySpark, Python, SQL and Delta Lake.
• Experience optimising Databricks workloads for performance, scalability and cost efficiency.
• Experience delivering solutions in insurance, financial services or regulated industries.
• Ability to translate business needs into technical requirements.
• Good project management skills; experience managing projects with multiple senior stakeholders.
• Experience managing and mentoring engineering teams.

Responsibilities

• Being the primary technical contact on data for new projects and designing data solutions.
• Design scalable Medallion Architecture solutions (Bronze, Silver, Gold).
• Ensure data governance, lineage, security, and compliance are embedded.
• Provide technical leadership across multiple squads.
• Define processes, drive automation, and provide technical roadmaps to target state.
• Coach and mentor team members; act as escalation point for technical issues.
• Coordinate with vendors to align data roadmaps.
• Collaborate with stakeholders to meet needs and standards.
• Lead data product design and be the technical expert in data engineering tools.
• Focus on resilience, availability, and recovery for operational resilience.

Skills

Mentoring

Leadership

Stakeholder management

Project management

Tools

Databricks

PySpark

Python

Delta Lake

Databricks SQL

SQL

Databricks Genie

Job description

Markerstudy Group Services Limited is seeking a Principal Data Engineer to act as the senior technical authority for the Databricks Lakehouse platform. You will define engineering standards, architecture, and best practices while leading the design and delivery of scalable, secure data products using Databricks, Delta Lake, Unity Catalog and Azure Data Services.

The role requires strong leadership across squads, governance, and resilience, with a focus on end-to-end data product delivery and