Hybrid Senior Data Engineer: GCP Data Pipelines & Mentoring

So Energy; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Hybrid Working

Learning Platform

Educational Sponsorships

Real Living Wage Employer

Birthday Off

Three So Giving Days

Enhanced Family Leave

Employee Assistance Programme

Job summary

So Energy in London (Chiswick) is seeking a Senior Data Engineer to design, build and scale data pipelines on the Google Cloud Platform. You will own hands‑on implementation, optimize pipelines, and mentor junior engineers while advancing our lakehouse and data governance.

You’ll work in a hybrid setup with cross‑functional partners, apply best practices, and contribute to high‑impact analytics projects that power sustainable energy solutions.

Qualifications

• Extensive experience building data pipelines on GCP with BigQuery, Dataflow and Cloud Storage.
• Strong SQL expertise for complex transformations and optimization.
• Proficient in Python for scalable data workflows and orchestration.
• IaC with Terraform to automate GCP resources and environments.
• Experience with CI/CD and containerization (Docker/Kubernetes) is essential.
• Understanding of data governance, IAM and security best practices.

Responsibilities

• Design, develop, and maintain scalable data pipelines on GCP.
• Build and optimize a lakehouse architecture and data models.
• Implement ingestion, transformation, and loading from diverse sources.
• Ensure data quality, security, and cost efficiency.
• Collaborate with analysts to support analytics solutions.
• Mentor junior data engineers and contribute to best practices.

Skills

GCP stack (BigQuery, Dataflow, Pub/Sub

SQL

Python

Terraform (IaC)

CI/CD pipelines

Docker

Kubernetes

Data modeling (star schema)

Data governance & IAM

Batch & streaming data pipelines

Tools

Docker

Kubernetes

Terraform

Job description

So Energy in London (Chiswick) is seeking a Senior Data Engineer to design, build and scale data pipelines on the Google Cloud Platform. You will own hands‑on implementation, optimize pipelines, and mentor junior engineers while advancing our lakehouse and data governance.

You’ll work in a hybrid setup with cross‑functional partners, apply best practices, and contribute to high‑impact analytics projects that power sustainable energy solutions.