Principal Data Engineer

Corecom Consulting; Southampton; Hybrid; GBP 80,000 - 95,000; Full time

Job summary

A technology consulting firm in the UK seeks a Principal Data Engineer to lead the technical direction of their data platform. This senior role involves defining strategy, designing scalable data architectures, and ensuring data governance while mentoring engineers. Ideal candidates will have expertise in PySpark, Databricks, and SQL, alongside strong experience in Azure data warehouses. This is an influential position ideal for those who thrive in both strategic and execution capacities, shaping the data landscape for a growing organization.

Benefits

Bonus of up to 17%

Yearly equity gift worth 10% of base salary

Qualifications

• Deep expertise in PySpark and distributed data processing at scale.
• Strong hands on experience designing, building, and optimising Databricks based platforms.
• Advanced SQL skills including performance optimisation and schema design for analytical workloads.
• Experience working across Azure-based data warehouses, with some exposure to AWS.
• Proven experience defining and leading complex data architectures rather than just implementing them.
• Strong understanding of data governance, data quality frameworks, and security best practices.
• A track record of influencing senior stakeholders and aligning data strategy with business objectives.
• Experience mentoring senior engineers and setting technical standards without formal line management.
• A strategic mindset with a clear focus on data reliability, scalability, and long term business value.

Responsibilities

• Defining and owning the technical strategy for the data platform across ingestion, processing, and analytics.
• Designing scalable, secure, and high performance architectures using Databricks and distributed data systems.
• Building and overseeing robust data ingestion pipelines using PySpark, focusing on reliability and accuracy.
• Ensuring end to end data quality from raw ingestion through to curated datasets used for reporting and analytics.
• Establishing and enforcing best practices around data governance, lineage, metadata, and security.
• Anticipating future scaling challenges and ensuring the platform is fit for long term growth.
• Acting as a technical authority across data engineering teams, raising standards and guiding architectural decisions.
• Partnering with product, engineering, and commercial leaders to prioritise high impact data initiatives.
• Ensuring data platforms comply with GDPR and wider regulatory requirements.
• Evaluating and introducing new technologies where they add clear value to the data ecosystem.

Skills

PySpark

Databricks

SQL

Azure

Data governance

Data architecture

Data quality frameworks

Tools

Azure

AWS

Job description

Principal Data Engineer

Location: Flexible UK

Salary: £95,000 plus bonus of up to 17 per cent and a yearly equity gift worth 10 per cent of base

I am working with a scaling technology organisation operating across multiple brands within the property and legal technology space. As the business continues to grow and mature its data capability, they are now looking to hire a Principal Data Engineer to define and lead the technical direction of their data platform.

This is a senior, highly influential role sitting above multiple engineering teams. While there is a strong hands on element, this position is first and foremost about technical leadership, architecture, and setting standards. You will shape how data is ingested, governed, and trusted across the organisation, playing a central role in building a robust and scalable data warehouse and data platform as the business evolves.

The environment spans Azure and AWS, with Databricks at the core of the data stack. You will work closely with senior engineering, product, and business stakeholders to design future proof data architectures that can scale with increasing data volumes and complexity. As the organisation grows, this role offers a genuine opportunity to architect a modern data warehouse and lake that underpins insight across the UK housing market.

This role is ideal for a principal level engineer who enjoys operating at both strategic and execution levels. Someone comfortable defining architecture and governance with senior leaders, while also rolling up their sleeves to build and optimise complex data pipelines.

What you will be doing

• Defining and owning the technical strategy for the data platform across ingestion, processing, and analytics
• Designing scalable, secure, and high performance architectures using Databricks and distributed data systems
• Building and overseeing robust data ingestion pipelines using PySpark, with a strong focus on reliability and accuracy
• Ensuring end to end data quality from raw ingestion through to curated datasets used for reporting and analytics
• Establishing and enforcing best practices around data governance, lineage, metadata, and security, including Unity Catalogue
• Anticipating future scaling challenges and ensuring the platform is fit for long term growth
• Acting as a technical authority across data engineering teams, raising standards and guiding architectural decisions
• Partnering with product, engineering, and commercial leaders to prioritise high impact data initiatives
• Ensuring data platforms are compliant with GDPR and wider regulatory requirements
• Evaluating and introducing new technologies where they add clear value to the data ecosystem

What you will bring

• Deep expertise invilupp? No, it's "Deep expertise in PySpark and distributed data processing at scale"
• Strong hands on experience designing, Bangor? Sorry: "Strong hands on experience designing, building, and optimising Databricks based platforms"
• Advanced SQL skills including performance optimisation and schema design for analytical workloads
• Experience working across Azure based data warehouses, with some exposure to AWS
• Proven experience defining and leading complex data architectures rather than just implementing them Ferdinand? Text: "Proven experience defining and leading complex data architectures rather than just implementing them"
• Strong understanding of data governance, data quality frameworks, and security best practices
• A track record of influencing senior stakeholders and aligning data strategy with business objectives
• Experience mentoring senior engineers and setting technical standards without formal line management
• A strategic mindset with a clear focus on data reliability, scalability, and long term business value

If you are a Principal Data Engineer looking for a role where you can genuinely shape a growing data platform and influence technical direction at scale, I would be happy to share further details in confidence.