Remote Azure Databricks Data Engineer | PySpark & ETL Lead

Ceox; United Kingdom; Remote; GBP 83,000 - 131,000; Full time

Job summary

Ceox is recruiting a Data Engineer to design and deliver scalable data pipelines and data models in a modern Azure-based environment. You will collaborate with architects, analysts and engineers to implement data flows aligned to the organisation’s new Target Operating Model for Data.

The role focuses on building ETL pipelines, ingestion patterns, and secure data platforms in a remote, UK-based setting. Hands-on coding, problem solving and independent ownership are expected.

Qualifications

• Experience building ETL pipelines and data lakes.
• Proficient in Python, PySpark and SQL for data engineering.
• Strong problem-solving and collaborative mindset.

Responsibilities

• Build and maintain ETL pipelines and code in cloud data platforms.
• Support ingestion activity and onboarding of new data sources.
• Work with the Databricks Data Intelligence Platform and develop Data Engineering workloads.
• Construct raw, refined and curated data layers; catalogue assets appropriately.
• Validate solutions against functional and non-functional requirements.
• Deliver datasets, transformations and performance-optimised data products.
• Improve processes, engineering patterns, and reusable tooling.
• Monitor and measure pipeline performance; support incident resolution.
• Ensure documentation meets acceptance standards and is approved centrally.
• Actively engage in Agile ceremonies and governance forums.

Skills

Python

PySpark

SQL

ETL design

SOLID principles

Async programming

Unit testing

Data governance concepts

Power BI concepts

Tools

Databricks

Azure Data Factory

Fabric

Purview

Event Grid / Pub-Sub

Job description

Ceox is recruiting a Data Engineer to design and deliver scalable data pipelines and data models in a modern Azure-based environment. You will collaborate with architects, analysts and engineers to implement data flows aligned to the organisation’s new Target Operating Model for Data.

The role focuses on building ETL pipelines, ingestion patterns, and secure data platforms in a remote, UK-based setting. Hands-on coding, problem solving and independent ownership are expected.