DV-Cleared Data Engineer — Secure, Hybrid, High-Impact

CBSbutler; West of England; Híbrido; GBP 76.000 - 83.000; Tempo integral

Benefícios oferecidos por esta vaga

Hybrid working

Resumo da vaga

CBSbutler is seeking an experienced Data Engineer for a Defence/MOD programme based in Bristol/Wiltshire with hybrid working. You will design, build and maintain secure data solutions across the full lifecycle, collaborating with Data Scientists, Analysts and DevOps teams.

The role requires strong Python/SQL, NiFi, data modeling and experience with containerised environments such as OpenShift or Kubernetes. Clear DV or EDV clearance is essential.

Qualificações

• Proven commercial experience delivering Data Engineering solutions in project or production environments.
• Strong Python and SQL skills.
• Hands-on experience with Apache NiFi and data pipeline orchestration.
• Data modelling and schema design.
• Parquet and S3-compatible object storage.
• REST API integration.
• OpenShift or Kubernetes.
• GitLab CI/CD and automated build, test and deployment pipelines.
• Developing data contracts or Interface Control Documents (ICDs).
• Data validation and assurance.
• Metadata management, data lineage and traceability.
• Strong problem-solving and critical-thinking skills.
• Confident communication with technical and customer stakeholders.

Responsabilidades

• Design, build and maintain secure and scalable data engineering solutions.
• Develop and maintain data ingestion and transformation pipelines using Python, SQL and Apache NiFi.
• Design data models, schemas and data contracts / Interface Control Documents (ICDs).
• Integrate data from REST APIs and other source systems.
• Work with Parquet and S3-compatible object storage.
• Implement data validation, assurance, metadata management and data lineage.
• Develop automation and data-driven tools to support customer requirements.
• Contribute to technical decisions and investigate emerging technologies where appropriate.
• Work collaboratively with technical and customer stakeholders to understand requirements and deliver solutions.
• Take ownership of technical deliverables, ensuring they are secure, high quality and maintainable.

Conhecimentos

Python

SQL

Apache NiFi

Data modeling

REST API integration

OpenShift or Kubernetes

GitLab CI/CD

Data validation

Data lineage

Communication

Formação

STEM degree

Ferramentas

Parquet

S3-compatible storage

Descrição da vaga

CBSbutler is seeking an experienced Data Engineer for a Defence/MOD programme based in Bristol/Wiltshire with hybrid working. You will design, build and maintain secure data solutions across the full lifecycle, collaborating with Data Scientists, Analysts and DevOps teams.

The role requires strong Python/SQL, NiFi, data modeling and experience with containerised environments such as OpenShift or Kubernetes. Clear DV or EDV clearance is essential.