Lead Databricks Lakehouse Architect – Hybrid UK

KDR Talent Solutions; Cambridge; Hybrid; GBP 70,000 - 90,000; Full time

Job summary

A pioneering medical technology company seeks a Senior Data Engineer to architect and lead a scalable Databricks Lakehouse platform on AWS. You will be integral in transforming how data is leveraged from robotics and R&D, requiring deep expertise in Databricks, AWS, and data engineering principles. This greenfield opportunity allows you to solve complex data challenges with a dedicated team, contributing to a mission that improves surgical outcomes worldwide. Flexible hybrid working and comprehensive benefits are offered.

Benefits

Comprehensive benefits package

Flexible hybrid working

Career-defining project

Qualifications

• Proven experience with Databricks and Delta Lake.
• Strong expertise in AWS (e.g. S3, IAM).
• Expert-level Python and SQL skills.
• A strong understanding of data modelling principles.
• Ability to communicate complex concepts to non-technical stakeholders.

Responsibilities

• Architect and lead the design of a Databricks Lakehouse platform.
• Build and optimise robust ELT/ETL pipelines using Python and Spark.
• Work with complex datasets from IoT-enabled systems.
• Establish best data models and governance standards.
• Mentor other engineers to develop Databricks capabilities.

Skills

Databricks expertise

AWS data ecosystem knowledge

Python

SQL

Data modelling principles

Job description

A pioneering medical technology company seeks a Senior Data Engineer to architect and lead a scalable Databricks Lakehouse platform on AWS. You will be integral in transforming how data is leveraged from robotics and R&D, requiring deep expertise in Databricks, AWS, and data engineering principles. This greenfield opportunity allows you to solve complex data challenges with a dedicated team, contributing to a mission that improves surgical outcomes worldwide. Flexible hybrid working and comprehensive benefits are offered.