Security‑Focused Data Engineer for GenAI & Real‑Time Data

Capgemini; Manchester; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

Capgemini UK is seeking a code-first Data Engineer to design and build scalable data applications for Defence customers. You will work at the intersection of software and data engineering, delivering reliable data services.

You will containerise your services and deploy into secure Kubernetes or cloud environments, using modern CI/CD practices. This role emphasises observability, data governance and responsible AI in mission‑critical contexts.

Qualifications

• Core engineering skills: Python, OOP, automated testing and version control.
• Data engineering stack: pipelines with streaming frameworks and relational storage.
• Orchestration: modern frameworks like Airflow, Dagster or Prefect.
• Data quality and lineage: testing, documentation and lineage tooling.
• AI/MLOps: operationalising ML, GenAI, guardrails and observability.

Responsibilities

• Building modular data applications that process and expose data with tests and observability.
• Designing streaming and real-time data ingestion patterns for reliability.
• Defining data workflows programmatically and managing dependencies and errors.
• Packaging and deploying ML/GenAI workloads inside secured environments.
• Containerising services and deploying into secure Kubernetes or cloud environments.
• Implementing health monitoring, logging, metrics and data lineage for auditability.

Skills

Python

Data pipelines

Cloud platforms

PostgreSQL

Spark

Kafka

CI/CD

Tools

Docker

Kubernetes

Airflow

Dagster/Prefect

dbt

Great Expectations

Databricks

Snowflake

Job description

Capgemini UK is seeking a code-first Data Engineer to design and build scalable data applications for Defence customers. You will work at the intersection of software and data engineering, delivering reliable data services.

You will containerise your services and deploy into secure Kubernetes or cloud environments, using modern CI/CD practices. This role emphasises observability, data governance and responsible AI in mission‑critical contexts.