Senior Data Engineer — Databricks Lakehouse & IDMC

Severn Trent; Coventry; On-site; GBP 75,000 - 105,000; Full time

Benefits offered by this job

28 days holiday

Annual bonus

Family-friendly policies

Pension scheme

Sharesave

Training & development

EV scheme

Volunteering days

Job summary

Severn Trent is building a new data platform and seeks a Senior Data Engineer to contribute hands-on expertise. You will work on a Databricks-based lakehouse with Informatica IDMC for ingestion, designing robust Spark pipelines and data models for analytics.

You will join a 14-person Data Engineering team at the Coventry head office, with a 37-hour work week and flexibility to work from home as needed. This is a challenging, impactful data role in a leading utility company.

Qualifications

• Strong PySpark pipeline development in production.
• Solid grasp of Spark execution: partitioning, shuffles, joins, performance trade-offs.
• Hands-on Databricks experience in real delivery environments.
• Experience with Informatica IDMC for governed ingestion.
• Strong SQL across raw, curated, and consumer-ready data layers.

Responsibilities

• Design, build and operate Spark pipelines on Databricks with schema evolution and backfills.
• Use Informatica IDMC to implement governed ingestion patterns.
• Model Bronze/Silver/Gold lakehouse datasets for analytics.
• Implement automated data quality checks and data reliability controls.
• Tune Spark workloads and storage layouts for performance and cost.

Skills

PySpark

Spark tuning

Databricks

Informatica IDMC

SQL

Azure Synapse

Tools

Databricks

Informatica IDMC

Azure Synapse

Job description

Severn Trent is building a new data platform and seeks a Senior Data Engineer to contribute hands-on expertise. You will work on a Databricks-based lakehouse with Informatica IDMC for ingestion, designing robust Spark pipelines and data models for analytics.

You will join a 14-person Data Engineering team at the Coventry head office, with a 37-hour work week and flexibility to work from home as needed. This is a challenging, impactful data role in a leading utility company.