Senior Data Engineer (eDV Cleared) — Cloud & Pipelines

Raytheon; Greater London; On-site; GBP 50,000 - 90,000; Full time

Job summary

Raytheon UK is seeking a Principal Data Engineer to join an experienced Software Engineering function in London on a permanent, onsite basis. You will work in a cross-functional Agile team, building data pipelines and transforming data for analytics.

The role offers a competitive salary, strong pension, flex benefits, and a 37-hour week with early Friday finish. Key requirements include active eDV clearance, experience with Python, PySpark, Spark, Airflow, AWS/Azure/GCP, Kafka, SQL/NoSQL stores,

Qualifications

• Active eDV clearance is required.
• Experience in an Agile delivery team.
• Strong analytical skills with unstructured datasets.
• Proficient Python stack: PySpark, Pandas, PyArrow.
• Knowledge of Spark and distributed data processing.
• Experience with ETL tools like Airflow, AWS Step Functions, NiFi.
• Experience with AWS/Azure/GCP.
• Knowledge of Kafka, SQS or similar messaging/streaming.
• SQL and NoSQL storage such as HDFS, Iceberg, Elastic, S3 or data lakes.
• Experience with Docker, Kubernetes or OpenShift.
• Familiarity with testing frameworks and best practices.
• Familiarity with code repositories, branching, PRs and merges.

Responsibilities

• Build and maintain data processing pipelines to clean, transform, and aggregate data from disparate sources.
• Transform and optimise data for analytical use.
• Collaborate with stakeholders and other engineers.
• Contribute to project milestones.
• Contribute to continuous improvement within the team.
• Collaborate on the team's technical direction.

Skills

Active clearance

Agile delivery

Python

PySpark

Pandas

PyArrow

Apache Spark

Airflow

AWS

Azure

GCP

Kafka

SQS

SQL

NoSQL

HDFS

Iceberg

Elastic

S3

Docker

Kubernetes

OpenShift

Testing frameworks

Git

Tools

PySpark

Airflow

Spark

Docker

Kubernetes

OpenShift

Git

AWS

Azure

GCP

Job description

Raytheon UK is seeking a Principal Data Engineer to join an experienced Software Engineering function in London on a permanent, onsite basis. You will work in a cross-functional Agile team, building data pipelines and transforming data for analytics.

The role offers a competitive salary, strong pension, flex benefits, and a 37-hour week with early Friday finish. Key requirements include active eDV clearance, experience with Python, PySpark, Spark, Airflow, AWS/Azure/GCP, Kafka, SQL/NoSQL stores,