Senior DataOps Engineer — Cloud Data Pipelines & Governance

SF Partners

Newcastle upon Tyne

Hybrid

GBP 70,000 - 110,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

SF Partners is recruiting a Senior Data Engineer (DataOps) for a full-time, hybrid role in the United Kingdom, with offices in London, Newcastle, Birmingham, Bristol or Manchester. You will lead automated releases for complex data workloads across AWS, Azure and GCP, partnering with client delivery teams in regulated environments.

You will embed DataOps best practices, architect pipelines with Airflow, containerize workloads with Docker and Kubernetes, and implement IaC using Terraform or

Qualifications

  • Substantial DataOps engineering experience in regulated environments.
  • Experience orchestrating workflows with Airflow, Prefect, or Dagster.
  • Containerisation for data apps using Docker and deploying to Kubernetes/AKS/EKS.
  • IaC with Terraform or Ansible to provision data infra.
  • Knowledge of cloud data ecosystems (AWS, Azure, GCP, Databricks, Snowflake).
  • Familiarity with Spark, Kafka, PostgreSQL in data landscapes.
  • Experience in air-gapped or SC-cleared environments and stakeholder consulting.

Responsibilities

  • Architect, automate, and manage continuous delivery pipelines for data applications, ensuring safe, repeatable, and audited releases.
  • Design and orchestrate complex workflow pipelines using Airflow, Prefect, or Dagster.
  • Package and deploy self-contained data workloads into container platforms (Docker/Kubernetes) across AWS/EKS, Azure AKS.
  • Implement IaC with Terraform or Ansible to provision, maintain, and standardise data infrastructure environments.
  • Embed robust monitoring, alerting, and observability across platforms to protect data reliability.
  • Provide technical direction and consult with client stakeholders for deployments in air-gapped/classified environments.

Skills

DataOps
Airflow
Docker
Kubernetes
Terraform
Ansible
AWS
Azure
GCP
Databricks
Snowflake
Spark
Kafka
PostgreSQL
SC clearance

Tools

Docker
Kubernetes
Terraform
Ansible

Job description

SF Partners is recruiting a Senior Data Engineer (DataOps) for a full-time, hybrid role in the United Kingdom, with offices in London, Newcastle, Birmingham, Bristol or Manchester. You will lead automated releases for complex data workloads across AWS, Azure and GCP, partnering with client delivery teams in regulated environments.

You will embed DataOps best practices, architect pipelines with Airflow, containerize workloads with Docker and Kubernetes, and implement IaC using Terraform or

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior DataOps Engineer – Cloud Data Pipelines
Senior DataOps Engineer – Cloud Data Pipelines

Alfa AI • Birmingham

Hybrid
GBP 70,000 - 100,000
Hybrid work model
Career development
Professional certification support
Senior DataOps Engineer: Cloud Pipelines (Hybrid)
Senior DataOps Engineer: Cloud Pipelines (Hybrid)

Alfa AI • Bristol

Hybrid
GBP 70,000 - 120,000
Senior Data Engineer (DataOps)
Senior Data Engineer (DataOps)

Alfa AI • Bristol

Hybrid
GBP 70,000 - 120,000
Senior Data Engineer (DataOps)
Senior Data Engineer (DataOps)

Alfa AI • Birmingham

Hybrid
GBP 70,000 - 100,000
Hybrid work model
Career development
Professional certification support
Senior Data Engineer - DataOps & AI Pipelines (Flexible)
Senior Data Engineer - DataOps & AI Pipelines (Flexible)

Government Recruitment Service • Manchester

On-site
GBP 44,000 - 53,000
Disability Confident employer
Flexible working
Space to grow and take ownership
Senior Data Engineer (DataOps)
Senior Data Engineer (DataOps)

SF Partners • Newcastle upon Tyne

Hybrid
GBP 70,000 - 110,000
Senior Data Engineer - Cloud Pipelines & Analytics
Senior Data Engineer - Cloud Pipelines & Analytics

Data Idols • Greater London

Hybrid
GBP 80,000 - 95,000
DataOps Engineer: Secure, Automated Pipelines (Hybrid)
DataOps Engineer: Secure, Automated Pipelines (Hybrid)

Capgemini • Greater London

Hybrid
GBP 80,000 - 120,000
Hybrid working
Training opportunities
Senior Data Consultant: Secure AWS Pipelines Lead (Hybrid)
Senior Data Consultant: Secure AWS Pipelines Lead (Hybrid)

Cyber Security training courses • Greater London

Hybrid
GBP 83,000 - 109,000
Senior Data Engineer | Hybrid London | Lead Pipelines
Senior Data Engineer | Hybrid London | Lead Pipelines

dcoded. | B Corp ™ • Greater London

Hybrid
GBP 60,000 - 75,000
Hybrid working with flexible remote
9am–6pm working hours