Hybrid Data Engineer - Lakehouse & PySpark Expert

Ascendion; Chester; Hybrid; GBP 70,000 - 110,000; Full time

Job summary

Ascendion is hiring a hands-on Level 3 data engineer to design and deliver a target-state data platform, leveraging PySpark, Spark, Iceberg, and Databricks. The role focuses on building scalable batch, near-real-time, and streaming pipelines within a hybrid setup.

The engineer will work across architecture, product, and controls to implement Lakehouse data products, optimize performance, and ensure portability between on-premises and cloud environments.

Qualifications

• Expert-level hands-on PySpark and Spark engineering experience.
• Strong knowledge of Lakehouse architecture and Apache Iceberg.
• Strong SQL and data modelling skills.

Responsibilities

• Design, build and optimise enterprise-scale batch, near-real-time and streaming pipelines using PySpark, Spark and Kafka.
• Deliver target-state Lakehouse products using Iceberg, object storage and reusable data-engineering patterns.
• Engineer cloud data-processing solutions on Databricks and support portability across on-premises and cloud compute.

Skills

PySpark

Spark

Kafka

Airflow

Databricks

Tools

Iceberg

Databricks

Job description

Ascendion is hiring a hands-on Level 3 data engineer to design and deliver a target-state data platform, leveraging PySpark, Spark, Iceberg, and Databricks. The role focuses on building scalable batch, near-real-time, and streaming pipelines within a hybrid setup.

The engineer will work across architecture, product, and controls to implement Lakehouse data products, optimize performance, and ensure portability between on-premises and cloud environments.