Senior Data Engineer (DataOps)

SF Partners

Newcastle upon Tyne

Híbrido

GBP 70.000 - 110.000

Jornada completa

hace 12 horas
Sé de los primeros/as/es en solicitar esta vacante

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Descripción de la vacante

SF Partners is recruiting a Senior Data Engineer (DataOps) for a full-time, hybrid role in the United Kingdom, with offices in London, Newcastle, Birmingham, Bristol or Manchester. You will lead automated releases for complex data workloads across AWS, Azure and GCP, partnering with client delivery teams in regulated environments.

You will embed DataOps best practices, architect pipelines with Airflow, containerize workloads with Docker and Kubernetes, and implement IaC using Terraform or

Formación

  • Substantial DataOps engineering experience in regulated environments.
  • Experience orchestrating workflows with Airflow, Prefect, or Dagster.
  • Containerisation for data apps using Docker and deploying to Kubernetes/AKS/EKS.
  • IaC with Terraform or Ansible to provision data infra.
  • Knowledge of cloud data ecosystems (AWS, Azure, GCP, Databricks, Snowflake).
  • Familiarity with Spark, Kafka, PostgreSQL in data landscapes.
  • Experience in air-gapped or SC-cleared environments and stakeholder consulting.

Responsabilidades

  • Architect, automate, and manage continuous delivery pipelines for data applications, ensuring safe, repeatable, and audited releases.
  • Design and orchestrate complex workflow pipelines using Airflow, Prefect, or Dagster.
  • Package and deploy self-contained data workloads into container platforms (Docker/Kubernetes) across AWS/EKS, Azure AKS.
  • Implement IaC with Terraform or Ansible to provision, maintain, and standardise data infrastructure environments.
  • Embed robust monitoring, alerting, and observability across platforms to protect data reliability.
  • Provide technical direction and consult with client stakeholders for deployments in air-gapped/classified environments.

Conocimientos

DataOps
Airflow
Docker
Kubernetes
Terraform
Ansible
AWS
Azure
GCP
Databricks
Snowflake
Spark
Kafka
PostgreSQL
SC clearance

Herramientas

Docker
Kubernetes
Terraform
Ansible

Descripción del empleo

Bridge the critical divide between software engineering and modern data platforms by bringing enterprise-grade reliability, continuous automation, and robust delivery standards to mission-critical systems.

We are recruiting on behalf of a global IT services firm for a Senior Data Engineer (DataOps) for a full-time, permanent hybrid position in the United Kingdom, based from your nearest office in London, Newcastle, Birmingham, Bristol or Manchester. In this role, you will lead the charge in establishing safe, automated, and repeatable releases for complex data workloads across AWS, Azure, and GCP.

Partnering directly with client delivery teams, you will embed DataOps best practices across modern platforms such as Snowflake and Databricks, architecting dependable pipelines while ensuring strict governance and observability across sensitive, air-gapped, and regulated environments. Please note that visa sponsorship is not available for this position, and candidates must be eligible to obtain UK Security Check (SC) clearance.

Key Responsibilities

  • Architect, automate, and manage continuous delivery pipelines for data applications, ensuring safe, repeatable, and audited releases.
  • Design and orchestrate complex workflow pipelines using orchestration engines such as Apache Airflow, Prefect, or Dagster.
  • Package and deploy self-contained data workloads into container platforms, leveraging Docker, Kubernetes, AWS EKS, and Azure AKS.
  • Implement Infrastructure as Code (IaC) using Terraform or Ansible to provision, maintain, and standardise data infrastructure environments.
  • Embed robust monitoring, alerting, and data observability solutions across platforms to proactively diagnose performance bottlenecks and protect data reliability.
  • Provide technical direction, consult with client stakeholders to translate complex requirements, and successfully deploy within air-gapped and classified government environments.

Required Skills & Experience

  • Substantial DataOps engineering experience, with a proven track record delivering automated pipelines within the UK public sector or heavily regulated environments.
  • Proven expertise orchestrating workflows with tools such as Apache Airflow, Prefect, or Dagster alongside CI/CD automation principles.
  • Strong background in containerisation for data applications, specifically containerising workloads using Docker and deploying to Kubernetes, AKS, or EKS.
  • Solid capability in Infrastructure as Code (IaC) using Terraform or Ansible, coupled with practical knowledge of cloud data ecosystems (AWS, Azure, GCP, Databricks, or Snowflake).
  • Familiarity with open-source distributed processing tools such as Apache Spark, Apache Kafka, or PostgreSQL.
  • Direct experience operating within restricted, air-gapped, or SC-cleared environments, paired with confident technical stakeholder consulting skills.

Nice-to-have

  • Professional certifications such as CKA, CKAD, or relevant cloud architecture credentials (AWS, Azure, GCP).
  • Formal DataOps training or specialised certifications in workflow orchestration tools.

What We Offer / Why Join

You will join a long-established global IT business with decades of history, a very large workforce and a diversified client base across the public sector, financial services, manufacturing, telecoms, retail and energy. It is a stable organisation, not a boutique dependent on a single contract.

Development and progression

  • Access to large technical communities and mentoring.
  • Opportunities to become a recognised technical subject matter expert.
  • Exposure to different clients and industries.
  • Potential to move between engineering, architecture and specialist disciplines.
  • Work alongside major technology partners, backed by significant research and R&D investment.
  • Exposure to new areas such as AI, data and cloud-native engineering.

The business places a strong emphasis on responsible technology, sustainability, ethics, diversity, innovation and technical learning. You will deploy data solutions in high-assurance settings and collaborate with multidisciplinary engineers and architects across modern cloud platforms.

The role is contractually 6 office days per month, though in practice it is mostly 2 days per month at the office closest to where you live (London, Newcastle, Birmingham, Bristol or Manchester), with the rest worked remotely.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Senior Data Engineer (DataOps)
Senior Data Engineer (DataOps)

Alfa AI • Bristol

Híbrido
GBP 70.000 - 120.000
Senior Data Engineer (DataOps)
Senior Data Engineer (DataOps)

Alfa AI • Birmingham

Híbrido
GBP 70.000 - 100.000
Hybrid work model
Career development
Professional certification support
Data Engineer
Data Engineer

Oscar • Manchester

Híbrido
GBP 65.000 - 85.000
Hybrid working
Competitive salary £65k-£85k
Senior Data Engineer
Senior Data Engineer

NPAworldwide • Manchester

Híbrido
GBP 50.000 - 70.000
Flexible working
Hybrid/remote working
Learning & Development
+5
Data Solutions Engineer
Data Solutions Engineer

NPAworldwide • Cardiff

Híbrido
GBP 50.000 - 70.000
Flexible working
Hybrid/remote working
Dev budget for conferences and courses
+3
Principal Data Engineer
Principal Data Engineer

NPAworldwide • Newport

Híbrido
GBP 50.000 - 70.000
Flexible working
Hybrid/remote working
Learning & Development
+5
Data Platform Engineer
Data Platform Engineer

NPAworldwide • Leeds

Híbrido
GBP 50.000 - 70.000
Flexible working
Hybrid/remote working
Learning & Development
+5
DataOps Engineer
DataOps Engineer

Capgemini • Gran Bretaña

Híbrido
GBP 60.000 - 90.000
Hybrid working
Training opportunities
Big Data Engineer
Big Data Engineer

NPAworldwide • Liverpool

Híbrido
GBP 50.000 - 70.000
Flexible working
Hybrid/remote working
Learning & Development
+5
Senior Data Engineer
Senior Data Engineer

TechNET • Leeds

Híbrido
GBP 83.000 - 129.000