Principal Data Engineer

Raytheon; Greater London; On-site; GBP 50,000 - 90,000; Full time

Job summary

Raytheon UK is seeking a Principal Data Engineer to join an experienced Software Engineering function in London on a permanent, onsite basis. You will work in a cross-functional Agile team, building data pipelines and transforming data for analytics.

The role offers a competitive salary, strong pension, flex benefits, and a 37-hour week with early Friday finish. Key requirements include active eDV clearance, experience with Python, PySpark, Spark, Airflow, AWS/Azure/GCP, Kafka, SQL/NoSQL stores,

Qualifications

• Active eDV clearance is required.
• Experience in an Agile delivery team.
• Strong analytical skills with unstructured datasets.
• Proficient Python stack: PySpark, Pandas, PyArrow.
• Knowledge of Spark and distributed data processing.
• Experience with ETL tools like Airflow, AWS Step Functions, NiFi.
• Experience with AWS/Azure/GCP.
• Knowledge of Kafka, SQS or similar messaging/streaming.
• SQL and NoSQL storage such as HDFS, Iceberg, Elastic, S3 or data lakes.
• Experience with Docker, Kubernetes or OpenShift.
• Familiarity with testing frameworks and best practices.
• Familiarity with code repositories, branching, PRs and merges.

Responsibilities

• Build and maintain data processing pipelines to clean, transform, and aggregate data from disparate sources.
• Transform and optimise data for analytical use.
• Collaborate with stakeholders and other engineers.
• Contribute to project milestones.
• Contribute to continuous improvement within the team.
• Collaborate on the team's technical direction.

Skills

Active clearance

Agile delivery

Python

PySpark

Pandas

PyArrow

Apache Spark

Airflow

AWS

Azure

GCP

Kafka

SQS

SQL

NoSQL

HDFS

Iceberg

Elastic

S3

Docker

Kubernetes

OpenShift

Testing frameworks

Git

Tools

PySpark

Airflow

Spark

Docker

Kubernetes

OpenShift

Git

AWS

Azure

GCP

Job description

Salary: £50,000 - 90,000 per year

Requirements:

• We require candidates to hold active eDV clearance.
• Experience working in an Agile delivery team.
• Strong analytical skills related to working with unstructured datasets.
• Knowledge of Python, including PySpark, Pandas, and PyArrow.
• Knowledge of distributed data processing, such as Apache Spark.
• Knowledge of data ETL tools, such as Apache Airflow, AWS Step Functions, or Apache NiFi.
• Experience with cloud services such as AWS, Azure, or GCP.
• Knowledge of messaging and streaming technologies such as Kafka, AWS SQS, or other cloud queuing services.
• Knowledge of SQL and NoSQL storage, such as HDFS, Iceberg, Elastic, S3, or data lakes.
• Knowledge of containerisation and orchestration tools such as Docker, Kubernetes, or Openshift.
• Knowledge of testing frameworks and best practices.
• Familiarity with code repositories, branching strategies, pull requests, and merge processes.
• We can provide training and development in some areas; candidates do not need expertise in every listed area.

Responsibilities:

• Build and maintain data processing pipelines that clean, transform, and aggregate data from disparate sources.
• Transform and optimise data for analytical use.
• Collaborate with stakeholders and other engineers.
• Contribute to the completion of project milestones.
• Contribute to continuous improvement within the team.
• Collaborate with peers on the teams technical direction.

Technologies:

• Airflow
• AWS
• Azure
• Cloud
• Docker
• ETL
• GCP
• Kafka
• Kubernetes
• NoSQL
• OpenShift
• Python
• PySpark
• SQL
• Security
• Spark
• pandas
• Support

More:

We are Raytheon UK, a defence and aerospace technology company working across the UK and supporting government and international customers with solutions across land, sea, air, space, and cyberspace, as well as digital and training transformation. Our National Security Cyber business delivers mission-critical solutions in a mature, agile environment, where SCRUM teams work with customers on complex digital challenges. This is a permanent, onsite Principal Data Engineer role based in London, within our experienced Software Engineering function and a cross-functional Agile team. We offer a competitive salary, a contributory pension with up to 10.5% company contribution, life assurance, 25 days holiday increasing with service, public holidays, the option to buy or sell up to five days, a discretionary bonus, flexible benefits, enhanced sick pay, and enhanced family-friendly leave. Our 37-hour working week includes an early Friday finish; working arrangements may vary by role and site. We also offer up to five paid volunteering days each year and a flexible working culture focused on output. We are committed to equal employment and give qualified applications careful consideration without regard to protected characteristics.

last updated 40 week of 2026