Senior Data Engineer - Databricks & Real-Time Analytics

Advantage Resourcing UK Ltd; City Of London; On-site; GBP 90,000 - 130,000; Full time

Job summary

Advantage Resourcing UK Ltd is supporting a trading client to hire a Senior Data Engineer focused on Databricks and Delta Live Tables. You will design scalable pipelines, enable real-time and batch analytics, and partner with cross-functional teams to deliver robust data solutions.

Key responsibilities include ingestion from SAP sources via Qlik Replicate and ADF, data modelling, and performance tuning for reliable insights across the organization.

Qualifications

• Bachelor's or Master’s degree in Computer Science, Engineering, or a related field.
• Strong experience with Databricks and Delta Live Tables, plus governance concepts.
• Fluent in Python/SQL and data engineering best practices.

Responsibilities

• Design scalable data pipelines using Databricks and Delta Live Tables.
• Develop streaming data solutions for real-time analytics.
• Ingest data from SAP systems and ensure data quality and consistency.
• Perform data modelling and optimize structures for analytics.
• Collaborate with cross-functional teams to meet data requirements.
• Monitor and improve data workflows for reliability and performance.

Skills

Databricks

Delta Live Tables

Python

SQL

Spark Streaming

Data modelling

ETL/ELT

Azure

Qlik Replicate

ADF

Education

CS/Engineering degree

Tools

Qlik Replicate

ADF

Azure

Databricks

Job description

Advantage Resourcing UK Ltd is supporting a trading client to hire a Senior Data Engineer focused on Databricks and Delta Live Tables. You will design scalable pipelines, enable real-time and batch analytics, and partner with cross-functional teams to deliver robust data solutions.

Key responsibilities include ingestion from SAP sources via Qlik Replicate and ADF, data modelling, and performance tuning for reliable insights across the organization.