Principal Data Engineer - Databricks Lakehouse Lead

Unifeye Ltd.; Greater London; Hybrid; GBP 110,000 - 165,000; Full time

Benefits offered by this job

Exclusive Databricks work

Ownership & autonomy

Principal-level career path

Impact on clients

Collaboration with Databricks

Continuous learning & certs

Flexible hybrid working

Job summary

Unifeye Ltd. is seeking an experienced Principal Engineer to lead hands-on build and delivery of modern data and AI solutions on the Databricks Lakehouse Platform.

You will set engineering standards, mentor colleagues, and partner with customers to solve complex business challenges alongside architects and AI specialists. As the most senior individual contributor, you’ll drive production-grade implementations, maintain code quality, and help grow Unifeye’s technical capability through

Qualifications

• 8+ years hands-on engineering delivering enterprise data platforms.
• Strong production experience with Databricks solutions.
• Deep Apache Spark expertise including performance tuning.
• Expert-level Python and SQL.
• Strong understanding of modern Lakehouse architecture and Unity Catalog.
• Consulting or customer-facing delivery experience.
• Experience with Azure, AWS or GCP.
• Experience implementing CI/CD, testing frameworks and deployment automation.
• Excellent communication and stakeholder management skills.

Responsibilities

• Lead the hands-on design, build and optimisation of enterprise data and AI solutions on the Databricks Lakehouse Platform.
• Engineer production-grade Lakehouse implementations using technologies such as Unity Catalog, Delta Live Tables, MLflow and Lakeflow.
• Own the hardest technical problems on an engagement - performance tuning, complex migrations, scale and reliability.
• Set engineering standards for code quality, testing, observability and reusability across delivery teams.
• Build reusable frameworks, accelerators and internal tooling that make every engagement faster and more consistent.
• Translate architectural direction into working, production-ready solutions, and feed engineering reality back into architecture.
• Lead technical workshops, code and design reviews, and deep-dive sessions with customers.
• Support Proof of Concepts and pre-sales engagements with credible, hands-on technical depth.
• Establish best practices for governance, security, CI/CD, DataOps and MLOps.
• Collaborate closely with Databricks and internal delivery teams.
• Mentor engineers and help grow the consultancy's technical capability.

Skills

Spark performance tuning

Python

SQL

Databricks Lakehouse

Unity Catalog

CI/CD

Cloud platforms

Stakeholder management

Job description

Unifeye Ltd. is seeking an experienced Principal Engineer to lead hands-on build and delivery of modern data and AI solutions on the Databricks Lakehouse Platform.

You will set engineering standards, mentor colleagues, and partner with customers to solve complex business challenges alongside architects and AI specialists. As the most senior individual contributor, you’ll drive production-grade implementations, maintain code quality, and help grow Unifeye’s technical capability through