Senior Data Engineer

Ceox

United States

Remote

USD 92,000 - 119,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Ceox is seeking a Data Engineer to build and optimise Azure-based ETL pipelines and data platforms. You will work with architects, analysts, and delivery teams to implement scalable data models, transformations and governance aligned to the organisation’s Target Operating Model for Data.

Hands-on experience with PySpark, SQL, and Databricks is essential; you will also engage in Agile ceremonies and ensure secure, well-documented engineering practices across the data lifecycle.

Qualifications

  • Build and maintain ETL pipelines in cloud data platforms.
  • Onboard and ingest new data sources.
  • Develop data engineering workloads on Databricks.

Responsibilities

  • Build and maintain ETL pipelines and code in cloud data platforms.
  • Support ingestion activity and onboarding of new data sources.
  • Work with the Databricks Data Intelligence Platform and develop Data Engineering workloads.
  • Construct raw, refined and curated data layers; catalogue assets appropriately.
  • Validate solutions against functional and non‑functional requirements.
  • Deliver datasets, transformations and performance‑optimised data products.
  • Improve processes, engineering patterns, and reusable tooling.
  • Monitor and measure pipeline performance; support incident resolution.
  • Ensure documentation meets acceptance standards and is approved centrally.
  • Actively engage in Agile ceremonies and governance forums.

Skills

Python
PySpark
SQL
SOLID principles
Async programming
Event-driven data ingestion

Tools

Azure Databricks
Azure Data Factory
Azure Fabric
Microsoft Purview
Event Grid
Pub-Sub
Entra IMID/SCIM
APIM
Power BI via Databricks

Job description

Data Engineer (Azure | Databricks | PySpark | SQL) Contract | Remote | UK Public Sector Project

We are seeking a Data Engineer to support delivery of key data components within our evolving data ecosystem. This role will work closely with architects, analysts, engineers, and wider delivery teams to implement pipeline builds, data models, and integration patterns aligned to the organisation’s new Target Operating Model for Data. You will contribute to the development of scalable data flows, optimise ingestion & transformation activities, and ensure solutions meet technical standards, performance expectations, and security controls. This is a hands‑on engineering role ideal for someone who enjoys building, shaping, and improving modern data platforms.

Who We’re Looking For

A highly capable Data Engineer with hands‑on experience building ETL pipelines, implementing Data Lake architectures, and working across Azure platform services. You will need strong problem‑solving ability, a solid engineering mindset, and the ability to work collaboratively within a multi‑disciplinary team. If you’re confident writing production‑grade code, applying design patterns, and building scalable, high‑performing data products, this role offers technical autonomy, ownership, and challenge.

Key Responsibilities
  • Build and maintain ETL pipelines and code in cloud data platforms.
  • Support ingestion activity and onboarding of new data sources.
  • Work with the Databricks Data Intelligence Platform and develop Data Engineering workloads.
  • Construct raw, refined and curated data layers; catalogue assets appropriately.
  • Validate solutions against functional and non‑functional requirements.
  • Deliver datasets, transformations and performance‑optimised data products.
  • Improve processes, engineering patterns, and reusable tooling.
  • Monitor and measure pipeline performance; support incident resolution.
  • Ensure documentation meets acceptance standards and is approved centrally.
  • Actively engage in Agile ceremonies and governance forums.
Mandatory Requirements
  • Strong experience with Python, PySpark & SQL for data engineering.
  • Hands‑on experience with Azure Databricks.
  • Strong knowledge of Azure Data Factory & Fabric.
  • Experience with Microsoft Purview.
  • Familiarity with Event‑driven data ingestion (Event Grid / Pub‑Sub).
  • Understanding of SOLID principles, Async programming, Mediator/Factory patterns.
  • Experience delivering unit + integration testing in Databricks.
  • Knowledge of Secure ETL design with Entra IMID/SCIM integration.
  • Understanding of Azure best practice, APIM, and platform governance.
  • Ability to build and serve Power BI models via Databricks data sources.
Desirable
  • Prior experience working within UK Public Sector environments.
Soft Skills
  • Strong stakeholder communication and cross-team collaboration.
  • Analytical and solution‑focused mindset.
  • Able to work independently, take ownership and drive progress.
  • Commitment to clean, scalable, well‑documented engineering.
  • Adaptable, proactive, and comfortable working in dynamic delivery environments.
Contract Details
  • Contract Type: Freelance / Contract
  • Location: Remote (UK‑based candidates preferred)
  • Start Date: ASAP
  • Clearance: Candidates must be eligible to work with UK Government departments / BPSS.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

Advancing Analytics • United States

Remote
USD 134,000 - 171,000
Senior Data Engineer (6-month contract)
Senior Data Engineer (6-month contract)

gravity9 • United States

Remote
USD 140,000 - 190,000
Lead Data Engineer at NPAworldwide Birmingham, AL
Lead Data Engineer at NPAworldwide Birmingham, AL

NPAworldwide • Birmingham (AL)

Hybrid
USD 67,000 - 94,000
Flexible hours
Hybrid/remote work
Learning budget
+5
Principal Data Engineering Consultant
Principal Data Engineering Consultant

Advancing Analytics • United States

Remote
USD 120,000 - 180,000
Remote work (UK-based)
Occasional travel
Data Engineering Consultant
Data Engineering Consultant

Advancing Analytics • United States

Remote
USD 93,000 - 132,000
Remote work from the UK
Occasional travel to customers
Senior Data Engineer
Senior Data Engineer

83zero • Baltimore (MD)

On-site
USD 120,000 - 150,000
Senior Azure Data Engineer: Databricks + PySpark, Remote UK
Senior Azure Data Engineer: Databricks + PySpark, Remote UK

Ceox • United States

Remote
USD 92,000 - 119,000
Senior Data Engineer
Senior Data Engineer

HumCap • Plano (TX)

Hybrid
USD 120,000 - 170,000
Azure Data Engineer
Azure Data Engineer

Recru • Fort Worth (TX), Arlington (TX), Dallas (TX)

On-site
USD 120,000 - 150,000
Senior Data Engineer — Remote UK (Azure, Spark)
Senior Data Engineer — Remote UK (Azure, Spark)

Advancing Analytics • United States

Remote
USD 134,000 - 171,000