Principal Data Engineer

eonnext; Greater London; On-site; GBP 85,000 - 115,000; Full time

Job summary

E.ON Next is building a data-driven organisation where trusted, high-quality data underpins decision-making. As a Principal Data Engineer, you will lead the design and scale of our Databricks-based data platform, delivering robust, production-grade data solutions for analytics, data science and operations.

In this role you will mentor the Data Engineering team, shape architecture, and collaborate with stakeholders to drive engineering excellence in a fast-paced environment.

Qualifications

• At least 5 years' experience as a Data Engineer or similar data-focused role, including 1 year in a Senior role.
• Strong experience with AWS (Amazon Web Services).
• Strong Python and SQL skills; ability to write production-quality code.
• Solid understanding of cloud-based data engineering design in AWS.
• Experience designing scalable data pipelines and data models.

Responsibilities

• Design, build and optimise scalable, high-performing data pipelines and data models within our Databricks platform.
• Integrate new data sources using batch and streaming/real-time approaches with reliable delivery and SLAs.
• Design and improve data quality, reliability and observability processes.
• Take ownership of complex engineering problems and deliver robust solutions aligned to business needs.
• Lead data engineering activity within delivery teams, providing technical direction and best practice patterns.
• Engage with senior data stakeholders to understand requirements and shape technical solutions.

Skills

Data engineering

Python

SQL

Problem solving

Autonomy

Tools

Databricks

Spark

AWS

Job description

At E.ON Next, we're building a data-driven organisation where trusted, high-quality data is at the heart of how we make decisions, serve our customers and deliver our strategy. As a Principal Data Engineer, you'll play a leading technical role in helping us mature and scale our Databricks-based data platform, creating robust, reliable and reusable data solutions that enable analytics, data science and operational decision making.

You'll be a senior technical expert within our Data Team, designing and building high-performing data pipelines and data models that help create a trusted single source of truth across E.ON Next. You'll take ownership of complex engineering challenges, applying strong engineering, governance and architectural principles to deliver production-grade solutions that are scalable, secure and built to last.

Working in a highly empowered environment, you'll provide technical leadership within delivery teams, shape technical approaches and influence engineering decisions. You'll also help raise the capability of the wider team through mentoring, knowledge sharing and championing engineering best practice.

A taste of what you'll be doing

• Design, build and optimise scalable, high-performing data pipelines and data models within our Databricks platform, continuously improving them as requirements and technology evolve.
• Integrate new data sources using batch and streaming/real-time approaches, ensuring reliable delivery and performance against agreed SLAs.
• Design and improve data quality, reliability and observability processes, helping ensure colleagues can trust the data they use.
• Take ownership of complex engineering problems, using your technical judgement to develop robust, pragmatic solutions aligned to business needs and architectural principles.
• Lead data engineering activity within delivery teams, providing technical direction and ensuring best practice engineering patterns are consistently applied.
• Engage with senior data stakeholders to understand requirements, shape technical solutions and influence technical decisions.
• Contribute to the design and evolution of our data platform, recommending improvements to architecture, pipeline design and engineering approaches.
• Develop and maintain clear documentation across data pipelines and associated systems, ensuring appropriate security, governance and operational standards are embedded.
• Work collaboratively across multi-skilled, cross-functional teams and with external partners to deliver consistent, scalable outcomes.
• Bring strong technical opinions and experience across a range of tools and frameworks, contributing to engineering discussions and helping the team make informed technical decisions.
• Coach, mentor and support other Data Engineers, helping to build technical capability and a culture of engineering excellence, peer review and continuous improvement.
• Work independently with appropriate autonomy and accountability, delivering high-quality solutions in a fast-paced and evolving environment.

Are we the perfect match?

We're looking for an experienced Data Engineer who combines deep technical expertise with strong problem-solving skills and the confidence to take ownership of complex engineering challenges. You'll be comfortable working with senior stakeholders, shaping technical solutions and providing technical leadership within delivery teams.

You'll bring

• At least 5 years' experience as a Data Engineer or in a similar data-focused role, including at least 1 year working as a Senior Data Engineer.
• Strong experience with Amazon Web Services (AWS).
• Strong experience with Databricks and/or Spark.
• Strong Python and SQL skills, with the ability to write production-quality code.
• A solid understanding of cloud-based data engineering design, particularly within AWS.
• Experience designing and delivering data extraction, transformation and aggregation solutions, including large-scale and real-time data where applicable.
• Strong understanding of data modelling, database design and data warehousing concepts.
• Experience designing repeatable, production-quality data pipelines using parameterisation, reusable patterns and engineering best practice.
• An understanding of data governance, data quality and data cataloguing principles and associated tools.
• Experience working with stakeholders to understand requirements and translate them into effective technical solutions.
• A proven ability to take ownership of complex data engineering problems and deliver robust solutions aligned to business needs.
• Strong problem-solving skills, with a structured approach to troubleshooting and root cause analysis.
• Strong attention to detail and a genuine curiosity about data.
• The confidence and adaptability to learn new tools and technologies and work effectively in a fast-paced environment.
• A self-starting approach, with the ability to set goals, take initiative and work with a high degree of autonomy.

It would be great if you had Pr