Senior Data Engineer – Real-Time Data & Infra

Xcede; England; On-site; GBP 70,000 - 110,000; Full time

Job summary

Xcede is partnering with a data-rich organisation in the UK with over 3 million customers to recruit a Senior Data Engineer. The role blends software engineering with data exploration, in a team of experienced data scientists, ML engineers and data engineers.

The Senior Data Engineer will oversee ETL, real-time streaming, and data infrastructure, delivering robust pipelines and CI/CD powered deployments. AWS and modern tooling form the backbone of the stack.

Qualifications

• Bachelor's degree in Computer Science or a related field.
• Strong Python coding skills.
• Commercial experience with Spark/Databricks/Airflow and Docker.
• Experience with CI/CD and cloud environments (AWS preferred).

Responsibilities

• Manage ETL, build pipelines, and scale data infrastructure to support data science and analytics initiatives.
• Design, implement and improve tools and services for orchestration, observability, data governance and data quality to high engineering standards.
• Deploy and manage products using CI/CD best practices.
• Collaborate with analytical stakeholders across business projects to diagnose issues.

Skills

Python

CI/CD practices

Data engineering

Education

Bachelor's degree in Computer Science or related field

Tools

Spark

Databricks

Airflow

Docker

Terraform

AWS

Job description

Xcede is partnering with a data-rich organisation in the UK with over 3 million customers to recruit a Senior Data Engineer. The role blends software engineering with data exploration, in a team of experienced data scientists, ML engineers and data engineers.

The Senior Data Engineer will oversee ETL, real-time streaming, and data infrastructure, delivering robust pipelines and CI/CD powered deployments. AWS and modern tooling form the backbone of the stack.