Senior DV-Cleared Data Engineer - Hybrid (3/5 Week)

CBSbutler; West of England; Hybrid; GBP 76,000 - 83,000; Full time

Job summary

CBSbutler is seeking a Senior Data Engineer with UK DV or EDV clearance for a Defence/MOD programme. The role focuses on designing and delivering secure, scalable data solutions throughout the data lifecycle, engaging with Data Scientists, Analysts and DevOps to ensure robust outcomes.

Hybrid working around Bristol/Wiltshire, with significant MOD site activity and a condensed 3-day workweek option paid as 5 days. DV/EDV clearance essential, contract initially 3 months with extension potential.

Qualifications

• Proven commercial experience delivering Data Engineering solutions in project or production environments.
• Strong Python and SQL skills.
• Hands-on experience with Apache NiFi and data pipeline orchestration.
• Data modelling and schema design.
• Parquet and S3-compatible object storage.
• REST API integration.
• OpenShift or Kubernetes.
• GitLab CI/CD and automated build, test and deployment pipelines.
• Developing data contracts or Interface Control Documents (ICDs).
• Data validation and assurance.
• Metadata management, data lineage and traceability.

Responsibilities

• Design, build and maintain secure and scalable data engineering solutions.
• Develop and maintain data ingestion and transformation pipelines using Python, SQL and Apache NiFi.
• Design data models, schemas and ICDs.
• Integrate data from REST APIs and other source systems.
• Work with Parquet and S3-compatible object storage.
• Implement data validation, governance and lineage.
• Develop automation and data-driven tools to support customer requirements.
• Contribute to technical decisions and investigate emerging technologies.
• Collaborate with stakeholders to understand requirements and deliver solutions.
• Take ownership of technical deliverables, ensuring security and maintainability.

Skills

Python

SQL

Apache NiFi

Data modelling

Parquet

S3 storage

REST API

OpenShift

Kubernetes

GitLab CI/CD

ICDs

Data validation

Data lineage

Education

STEM / Data / AI / Programming degree

Tools

OpenShift

Kubernetes

Terraform

Ansible

Spark

Hadoop

NiFi

Job description

CBSbutler is seeking a Senior Data Engineer with UK DV or EDV clearance for a Defence/MOD programme. The role focuses on designing and delivering secure, scalable data solutions throughout the data lifecycle, engaging with Data Scientists, Analysts and DevOps to ensure robust outcomes.

Hybrid working around Bristol/Wiltshire, with significant MOD site activity and a condensed 3-day workweek option paid as 5 days. DV/EDV clearance essential, contract initially 3 months with extension potential.