Databricks Data Platform Lead

Ronald James; Newcastle upon Tyne; On-site; GBP 38,000 - 78,000; Full time

Job summary

Ronald James in Newcastle upon Tyne is seeking a Principal Data Engineer to lead the evolution of our next-generation data platform. You will own architectural decisions, define roadmaps, and work hands-on with engineers and architects to ensure security, scalability, and performance.

This senior role combines strategy with practical delivery, collaborating across teams, shaping data contracts and governance, and mentoring colleagues while staying current with industry best practices.

Qualifications

• Proven experience designing large-scale data platforms with Databricks.
• Strong Python development skills and testing practices.
• Ability to own platform roadmaps and architectural decisions.
• Excellent collaboration and communication skills.

Responsibilities

• Design and implement secure, high-performance Databricks environments, including cluster setup, governance, and tuning.
• Define and own the technical roadmap for our data platform.
• Ensure systems meet standards for performance, security, maintainability, and reliability.
• Drive progress toward Service Level Objectives (SLOs).
• Collaborate with technical leads and architects to shape data solutions that meet product and business needs.
• Support cross-functional teams in removing technical blockers and enabling delivery.
• Maintain clear, high-quality technical documentation for data and BI systems.
• Act as a visible, collaborative technical voice within the business.
• Contribute to estimation and technical planning.
• Align all solutions with the wider technical strategy.
• Work with Solution Architects and Analysts to design scalable, forward-thinking solutions.
• Apply architectural principles such as domain modelling and modular design.
• Guide delivery and implementation with team leads.
• Provide hands-on support through code reviews, prototyping, and pair programming.
• Support incident response efforts and assist with resolving critical technical issues.
• Gain deep knowledge of internal BI tools and systems.
• Create and maintain technical documentation, including integration guides and data contracts.
• Support onboarding and knowledge transfer across teams.
• Stay current with modern best practices in data engineering and architecture.

Skills

Databricks

Python

Architecture

Roadmap ownership

Collaboration

Communication

Time management

Proactive mindset

Tools

Databricks

Python

Job description

Ronald James in Newcastle upon Tyne is seeking a Principal Data Engineer to lead the evolution of our next-generation data platform. You will own architectural decisions, define roadmaps, and work hands-on with engineers and architects to ensure security, scalability, and performance.

This senior role combines strategy with practical delivery, collaborating across teams, shaping data contracts and governance, and mentoring colleagues while staying current with industry best practices.