DataOps Engineer - Secure, Automated Data Pipelines

Capgemini; United Kingdom; Hybrid; GBP 60,000 - 90,000; Full time

Benefits offered by this job

Hybrid working

Training opportunities

Job summary

Capgemini seeks a DataOps Engineer to develop secure, automated data platforms for public sector clients. You will architect and deliver DataOps capabilities, focusing on repeatability, governance, and scalable data applications in air-gapped environments.

You will implement and manage monitoring and observability to ensure data quality across the data flow, using tools like Airflow, Docker, Terraform and Kubernetes, with a strong emphasis on CI/CD and IaC practices.

Qualifications

• Significant experience as a DataOps Engineer in public sector or similarly regulated environments.
• Developing, orchestrating and maintaining data pipelines with Airflow, Prefect or Dagster.
• Containerising data apps with Docker and deploying to container platforms (EKS, AKS, Kubernetes).
• Implementing CI/CD pipelines for data applications.
• Monitoring and troubleshooting data pipelines and applications.
• Working with IaC tools (Terraform, Ansible) to provision data infrastructure.

Responsibilities

• Deliver secure, automated and operational data solutions across public sector systems.
• Architect and deliver DataOps capabilities with a focus on repeatability and governance.
• Build and operate data pipelines with robust observability and data quality controls.

Skills

DataOps

Orchestration tools

Containerisation

CI/CD

Open-source data tools

IaC

Air-gapped development

Automation

Stakeholder management

Public sector domain

Technical architecture

Tools

Airflow

Prefect

Dagster

Docker

Kubernetes

EKS

AKS

Terraform

Ansible

Spark

Kafka

PostgreSQL

Job description

Capgemini seeks a DataOps Engineer to develop secure, automated data platforms for public sector clients. You will architect and deliver DataOps capabilities, focusing on repeatability, governance, and scalable data applications in air-gapped environments.

You will implement and manage monitoring and observability to ensure data quality across the data flow, using tools like Airflow, Docker, Terraform and Kubernetes, with a strong emphasis on CI/CD and IaC practices.