Principal Data Engineer - Hybrid Lakehouse & Databricks Lead

Markerstudy Group; Salford; Híbrido; GBP 65.000 - 90.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Starting with 25 days annual leave

Yearly bonus

Private Medical Insurance

Life Assurance 4x annual salary

Collaborative, fast paced working env

Hybrid Working

Modern, vibrant offices

Descripción de la vacante

Markerstudy Group is seeking an experienced Data Engineer to join our hybrid team. The role is based in our UK offices in Manchester, Stoke or Peterborough, with two days a week on-site. You will own the Databricks Lakehouse platform, define standards, and lead scalable data product design across the enterprise.

You will mentor engineers, collaborate with stakeholders, and drive resilience, governance and performance improvements. Experience with Databricks, Delta Lake and Python is essential.

Formación

• Expert-level Databricks experience.
• Advanced PySpark development.
• Delta Lake architecture and optimisation.
• Databricks SQL expertise.
• Experience with data warehouse and dimensional modelling.
• Experience with Data Lake architectures.
• Familiarity with Databricks Genie.
• Strong Python development skills.

Responsabilidades

• Primary technical contact on data for new projects; design data solutions.
• Design scalable Medallion Architecture (Bronze/Silver/Gold).
• Embed data governance, lineage, security and compliance in solutions.
• Provide technical leadership across multiple squads.
• Drive process improvements and automation with clear roadmaps.
• Coach and mentor team members; be escalation point for issues.
• Coordinate with vendors/data sources to align roadmaps.
• Work with stakeholders to meet needs and standards.
• Lead data product design end-to-end; be the technical expert.
• Focus on resilience, availability and recoverability for platforms.
• Manage resources: availability, capacity, performance and operability.
• Deliver robust data products within time and budget.
• Create clear documentation for data solutions.
• Communicate effectively with stakeholders and non-technical teams.
• Ensure high-quality, well-performing code.
• Provide training and develop data engineers.

Conocimientos

Databricks

PySpark

Delta Lake

Databricks SQL

Data Warehouse

Dimensional Modelling

Data Lake

Databricks Genie

Python

Herramientas

Databricks

Descripción del empleo

Markerstudy Group is seeking an experienced Data Engineer to join our hybrid team. The role is based in our UK offices in Manchester, Stoke or Peterborough, with two days a week on-site. You will own the Databricks Lakehouse platform, define standards, and lead scalable data product design across the enterprise.

You will mentor engineers, collaborate with stakeholders, and drive resilience, governance and performance improvements. Experience with Databricks, Delta Lake and Python is essential.