Senior Data Engineer: Azure Databricks & PySpark (Remote UK)

Ceox Services Ltd

United Kingdom

Remote

GBP 92,000 - 129,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Ceox Services Ltd is seeking a Data Engineer to support the delivery of data components within an evolving data ecosystem. The role collaborates with architects, analysts, engineers and delivery teams to implement pipelines, data models and integration patterns aligned to the Target Operating Model for Data.

The incumbent will build scalable data flows, optimise ingestion and transformation activities, and ensure solutions meet security and performance standards in a hands-on Azure Databricks

Qualifications

  • Strong Python, PySpark and SQL for data engineering.
  • Hands-on Azure Databricks experience.
  • Knowledge of Azure Data Factory & Fabric.
  • Experience with Purview and event-driven ingestion.
  • Knowledge of SOLID, Async programming, Mediator/Factory patterns.
  • Experience delivering unit and integration tests in Databricks.

Responsibilities

  • Build and maintain ETL pipelines and code in cloud data platforms.
  • Support ingestion and onboarding of new data sources.
  • Develop Databricks workloads on the Data Intelligence Platform.
  • Create raw, refined and curated data layers with cataloging.
  • Validate solutions against functional and non-functional requirements.
  • Deliver datasets and optimized data products.
  • Improve processes and reusable tooling.
  • Monitor pipeline performance and assist incident resolution.
  • Ensure documentation meets acceptance standards.
  • Participate in Agile ceremonies and governance forums.

Skills

Python
PySpark
SQL
Data engineering
SOLID principles
Async programming
Mediator/Factory patterns
Unit testing
Integration testing

Tools

Azure Databricks
Azure Data Factory
Fabric
Microsoft Purview
Event Grid
Pub-Sub
APIM
Entra IMID/SCIM

Job description

Ceox Services Ltd is seeking a Data Engineer to support the delivery of data components within an evolving data ecosystem. The role collaborates with architects, analysts, engineers and delivery teams to implement pipelines, data models and integration patterns aligned to the Target Operating Model for Data.

The incumbent will build scalable data flows, optimise ingestion and transformation activities, and ensure solutions meet security and performance standards in a hands-on Azure Databricks

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Azure Databricks Data Engineer | PySpark & ETL Lead
Remote Azure Databricks Data Engineer | PySpark & ETL Lead

Ceox • United Kingdom

Remote
GBP 83,000 - 131,000
Senior Data Engineer - Azure Databricks (Remote UK)
Senior Data Engineer - Azure Databricks (Remote UK)

EnerMech • United Kingdom

Remote
GBP 80,000 - 120,000
Senior Data Architect: Azure & Databricks Lakehouse (Remote)
Senior Data Architect: Azure & Databricks Lakehouse (Remote)

Ceox • Guildford

Remote
GBP 120,000 - 166,000
Senior Data Engineer (Remote)
Senior Data Engineer (Remote)

Ceox Services Ltd • United Kingdom

Remote
GBP 92,000 - 129,000
Senior Data Engineer
Senior Data Engineer

Ceox • United Kingdom

Remote
GBP 83,000 - 131,000
Senior Data Engineer - Azure & Databricks Platform
Senior Data Engineer - Azure & Databricks Platform

Ceox Services Ltd • United Kingdom

Remote
GBP 50,000 - 70,000
Remote working option
Senior Data Engineer
Senior Data Engineer

Ceox Services Ltd • United Kingdom

Remote
GBP 50,000 - 70,000
Remote working option
Senior Data Engineer - Databricks & Azure Lead (Hybrid)
Senior Data Engineer - Databricks & Azure Lead (Hybrid)

vavemga • Manchester

Hybrid
GBP 70,000 - 110,000
Hybrid working
Competitive base salary
Pension
+1
Senior Data Engineer - Azure PySpark ETL/ELT (Hybrid)
Senior Data Engineer - Azure PySpark ETL/ELT (Hybrid)

DWP Digital • Tees Valley

Hybrid
GBP 68,000 - 83,000
Hybrid working
Flexible hours
Civil service pension 28.97%
Remote Data Engineer - Databricks & PySpark Pipelines
Remote Data Engineer - Databricks & PySpark Pipelines

Airswift • United Kingdom

Remote
GBP 60,000 - 90,000