Energy Markets - Senior Data Engineer

Scottish and Southern Electricity Networks; City of Edinburgh; Hybrid; GBP 42,000 - 64,000; Full time

Job summary

A leading energy company is seeking a Senior Data Engineer to design and optimize data pipelines. The role involves programming in Python and working with platforms like Databricks and Azure. You will collaborate with various stakeholders to deliver high-quality analytics solutions. The position is flexible with a competitive salary ranging from £42,600 to £64,000, and includes numerous benefits such as enhanced leave and healthcare discounts.

Benefits

34 days annual leave

Enhanced maternity/paternity leave

Discounted healthcare

Salary sacrifice car leasing

Qualifications

• Extensive experience in programming/query language skills including Python/PySpark and SQL.
• Data engineering experience via data preparation, transformation & conversion.
• Experience in Databricks, Azure, ADF, Streamlit or alternatives.

Responsibilities

• Design, build, manage, and optimize data pipelines.
• Collaborate with stakeholders and IT teams to deliver data solutions.
• Ensure solutions align with long-term Data Strategy.

Skills

Python/PySpark

SQL

Data engineering

Databricks

Azure

Data governance

Microsoft DevOps

Agile delivery

Tools

Streamlit

Azure Data Factory

Job description

This job is brought to you by Jobs/Redefined, the UK's leading over-50s age inclusive jobs board.

SSE has big ambitions to be a leading energy company in a low carbon world. Following our commitment to invest £20.5 billion in low carbon projects to 2027, we have significant growth plans and are well on our way to achieving our ambition to build a world that's more sustainable and inclusive for you, your family, the community you live in and for generations to come. We are proud to be playing a crucial role in the net zero transition, ensuring we have the energy supplies required to meet the needs of our customers; procuring the fuel required by the generation plants and selling the power output from our renewable and low-carbon thermal assets.

Join us on our journey to net zero and help us power change.

About the Role

Base Location: Flexible - Glasgow, Edinburgh, Perth, Reading

While the location of this role is flexible within the UK, regular travel to SSE's key Energy Markets offices will be required.

Salary: £42,600 - £64,000 + performance‑related bonus + a range of benefits to support your finances, wellbeing and family.

Working Pattern: Permanent | Full Time | Flexible First options available

As the Senior Data Engineer within Energy Markets you will be responsible for designing, building, managing, and optimizing data pipelines and the data model used by our Data Scientists and Traders. Working closely with Data Management teams on governance and security as well as business stakeholders around projects and IT teams to deliver these data pipelines and models effectively into production. This role will focus on python development on the Databricks and Streamlit platforms to deliver operational tools and process efficiencies.

You will

• Architect, create, improve, and operationalise integrated and reusable data pipelines, tools and processes. Measuring performance, efficiency and robustness of data provision and best practice process approaches.
• Deliver commercial value through working with key business stakeholders, IT experts and subject‑matter experts and high‑quality analytics and data science solutions.
• Understand that solutions and developments need to fit with the long‑term Data Strategy for the analytics platform.
• Explore the opportunities presented by using the latest advances in technology and tools alongside contributing to ensure an appropriate operational model exists to support solutions in production.
• Possesses outstanding communication skills and encourages collaboration across EM. Building strong relationships throughout the business is crucial to preserving the trust and respect necessary for the team to continue offering support and guidance.

You have

• Extensive experience in programming/query language skills including Python/PySpark and SQL.
• Data engineering experience - via data preparation, transformation & conversion to allow for rapid processing of system data across a number of different formats & structures.
• Experience in Databricks, Azure,ADF, Streamlit or alternatives.
• A good understanding of data modelling, ELT design patterns, data governance, and security best practices.
• A problem‑solving mindset with a strong background in delivering using cloud‑based Microsoft Azure Data and Analytics capabilities, Microsoft DevOps and Agile delivery.

What's in it for you?

We offer an excellent package with 34 days annual leave entitlement. Enhanced maternity/paternity leave, discounted healthcare, salary sacrifice car leasing and much more, view our full benefits package on our careers site.

What happens now?

All applications should be made online, and I'll be back in touch after the vacancy closing date to let you know the outcome.

If you would like to discuss any working flexibly requirements or adjustments you may require throughout the recruitment and selection process, please contact Janet at [e-mail] or on 01738 351816.

EXTERNAL: Before commencing your role with SSE, you'll need to complete our pre-employment screening process. This will consist of a criminality and credit check.

INTERNAL: As a courtesy, please let your current line manager know you are applying.