DV Cleared Data Engineer - On-site London (Azure)

DataCareers; City Of London; On-site; GBP 70,000 - 110,000; Full time

Job summary

DataCareers is recruiting a DV cleared Data Engineer for a leading technology consultancy. You will join an established defence programme and be responsible for building, maintaining and improving data pipelines within a secure MoD environment.

On-site in London 4 days a week, you will work with Python, Azure, Kubernetes, Apache Airflow and Spark to deliver scalable data solutions while ensuring governance and data security in MoD-owned infrastructure.

Qualifications

• Experience building and maintaining production data pipelines.
• Experience delivering data solutions in secure defence or government environments.
• Proficient in Python and Spark-based data processing.
• Experience with Azure, Kubernetes and Apache Airflow.

Responsibilities

• Build and maintain robust data pipelines using Python.
• Work across Azure environments on the low side.
• Support data engineering workloads within Kubernetes environments on the high side.
• Develop and maintain workflows using Apache Airflow.
• Work with Apache Spark for large-scale data processing.
• Support the ongoing development and improvement of established data pipelines.
• Help ensure data remains within MoD-owned infrastructure in line with data governance requirements.
• Work within an existing long-running programme requiring additional delivery capacity.
• Active DV Clearance.

Skills

Python

Data pipelines

Data governance

Tools

Azure

Kubernetes

Apache Airflow

Apache Spark

Palantir

Job description

DataCareers is recruiting a DV cleared Data Engineer for a leading technology consultancy. You will join an established defence programme and be responsible for building, maintaining and improving data pipelines within a secure MoD environment.

On-site in London 4 days a week, you will work with Python, Azure, Kubernetes, Apache Airflow and Spark to deliver scalable data solutions while ensuring governance and data security in MoD-owned infrastructure.