Principal Data Engineer

E.ON Next; City Of London; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Annual leave

Pension

Bonus opportunities

Flexible benefits

Hybrid working

Job summary

E.ON Next is seeking a Principal Data Engineer to shape and scale our Databricks-based data platform, delivering robust data solutions for analytics and decision making. You’ll own complex data pipelines, govern data quality and collaborate with senior stakeholders to drive architectural choices.

In this role you’ll mentor engineers, set engineering standards, and lead delivery teams in a fast-paced environment, ensuring scalable, secure and production-ready data capabilities across the

Qualifications

• At least 5 years in Data Engineering with senior experience
• Strong AWS and Databricks/Spark expertise
• Production-grade data pipelines and governance experience

Responsibilities

• Design, build and optimise scalable data pipelines and data models in Databricks
• Lead data engineering activity within delivery teams and mentor others
• Engage with senior stakeholders to shape technical solutions and architecture
• Develop and maintain documentation across pipelines and systems
• Collaborate with cross-functional teams and external partners

Skills

AWS

Databricks

Spark

Python

SQL

Data modelling

Data warehousing

Data governance

Stakeholder engagement

Leadership & mentoring

Tools

Databricks

Spark

Python

SQL

Job description

At E.ON Next, we're building a data-driven organisation where trusted, high-quality data is at the heart of how we make decisions, serve our customers and deliver our strategy. As a Principal Data Engineer, you'll play a leading technical role in helping us mature and scale our Databricks-based data platform, creating robust, reliable and reusable data solutions that enable analytics, data science and operational decision making.

You'll be a senior technical expert within our Data Team, designing and building high-performing data pipelines and data models that help create a trusted single source of truth across E.ON Next. You'll take ownership of complex engineering challenges, applying strong engineering, governance and architectural principles to deliver production-grade solutions that are scalable, secure and built to last.

Working in a highly empowered environment, you'll provide technical leadership within delivery teams, shape technical approaches and influence engineering decisions. You'll also help raise the capability of the wider team through mentoring, knowledge sharing and championing engineering best practice.

A taste of what you'll be doing

• Design, build and optimise scalable, high-performing data pipelines and data models within our Databricks platform, continuously improving them as requirements and technology evolve.
• Integrate new data sources using batch and streaming/real-time approaches, ensuring reliable delivery and performance against agreed SLAs.
• Design and improve data quality, reliability and observability processes, helping ensure colleagues can trust the data they use.
• Take ownership of complex engineering problems, using your technical judgement to develop robust, pragmatic solutions aligned to business needs and architectural principles.
• Lead data engineering activity within delivery teams, providing technical direction and ensuring best practice engineering patterns are consistently applied.
• Engage with senior data stakeholders to understand requirements, shape technical solutions and influence technical decisions.
• Contribute to the design and evolution of our data platform, recommending improvements to architecture, pipeline design and engineering approaches.
• Develop and maintain clear documentation across data pipelines and associated systems, ensuring appropriate security, governance and operational standards are embedded.
• Work collaboratively across multi-skilled, cross-functional teams and with external partners to deliver consistent, scalable outcomes.
• Bring strong technical opinions and experience across a range of tools and frameworks, contributing to engineering discussions and helping the team make informed technical decisions.
• Coach, mentor and support other Data Engineers, helping to build technical capability and a culture of engineering excellence, peer review and continuous improvement.
• Work independently with appropriate autonomy and accountability, delivering high-quality solutions in a fast-paced and evolving environment.

Are we the perfect match?

We're looking for an experienced Data Engineer who combines deep technical expertise with strong problem-solving skills and the confidence to take ownership of complex engineering challenges. You'll be comfortable working with senior stakeholders, shaping technical solutions and providing technical leadership within delivery teams.

You’ll bring:

• At least 5 years' experience as a Data Engineer or in a similar data-focused role, including at least 1 year working as a Senior Data Engineer.
• Strong experience with Amazon Web Services (AWS).
• Strong experience with Databricks and/or Spark.
• Strong Python and SQL skills, with the ability to write production-quality code.
• A solid understanding of cloud-based data engineering design, particularly within AWS.
• Experience designing and delivering data extraction, transformation and aggregation solutions, including large-scale and real-time data where applicable.
• Strong understanding of data modelling, database design and data warehousing concepts.
• Experience designing repeatable, production-quality data pipelines using parameterisation, reusable patterns and engineering best practice.
• An understanding of data governance, data quality and data cataloguing principles and associated tools.
• Experience working with stakeholders to understand requirements and translate them into effective technical solutions.
• A proven ability to take ownership of complex data engineering problems and deliver robust solutions aligned to business needs.
• Strong problem-solving skills, with a structured approach to troubleshooting and root cause analysis.
• Strong attention to detail and a genuine curiosity about data.
• The confidence and adaptability to learn new tools and technologies and work effectively in a fast-paced environment.
• A self-starting approach, with the ability to set goals, take initiative and work with a high degree of autonomy.

It would be great if you had

• Previous experience with data migration projects.
• Experience coaching or mentoring other Data Engineers and contributing to a culture of best practice and peer review.
• Experience working with streaming or real-time data at scale.
• Experience within the energy sector or another complex, data-rich environment.

Here’s what else you need to know:

Role may close earlier due to high applications.

Location - London - E.ON Next, 47-53 Charterhouse Street, Farringdon, London, EC1M 6PB

Excellent parental leave allowance.

Award-Winning Workplace

We're proud to be named a Sunday Times Best Place to Work 2025 and the Best Place to Work for 16-34-year-olds

Outstanding Benefits

Enjoy 26 days of annual leave plus bank holidays, a generous pension, life cover, bonus opportunities and access to 20 flexible benefits with tax/NI savings

Flexible & Family-Friendly

Our industry-leading hybrid and family-friendly policies earned us double recognition at the Personnel Today Awards 2024. We're open to discussing how flexibility can work for you

Inclusive & Diverse

We're the only energy company in the Inclusive Top 50 UK Employers. We're also proud winners of Best Employer for Women and Human Company of the Year-recognising our inclusive, people-first culture

Support at Every Stage of Life

We're Fertility Friendly and Menopause Friendly accredited, with inclusive support for everyone

Accessible & Supportive

Do you consider yourself as having a disability? As a Disability Confident Employer, we guarantee interviews for disabled applicants who meet the minimum criteria for the role and will make any adjustments needed during the process

Invested in Your Growth

From inclusive talent networks to top-tier development programmes, we'll support your growth every step of the way

For all successful candidates. Due to the nature of this role your employment will be subject to a basic DBS (Disclosure Barring Service) check being carried out by ourselves via a 3rd party service provider