Principal Data Engineer: Pipelines, Analytics & Cloud

Raytheon Systems; City of Westminster; Hybrid; GBP 65,000 - 95,000; Full time

Benefits offered by this job

Competitive salary

Pension scheme

Life assurance

25 days holiday

Bonus scheme

Flexible benefits

Enhanced sick pay

Family friendly policies

Job summary

Raytheon UK is seeking a Principal Data Engineer to build and maintain data pipelines and transform data for analytics within an Agile cross-functional team. The role focuses on clean, transform, and aggregate data from diverse sources while collaborating with stakeholders and engineers.

You’ll contribute to project milestones, drive continuous improvement, and help set technical direction within the team, on a UK-wide scale with a focus on national security data solutions.

Qualifications

• Experience in an Agile delivery team.
• Strong analytics with unstructured data.
• Python (PySpark, Pandas, PyArrow).
• Distributed data processing (Apache Spark).
• Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi).
• Cloud services (AWS, Azure or GCP).
• Messaging / Streaming (Kafka, AWS SQS).
• SQL and NoSQL.
• Storage (HDFS, Iceberg, Elastic, S3, Data Lake).
• Containerisation and orchestration (Docker / Kubernetes / Openshift).
• Testing frameworks and best practices.
• Use of Code repositories, familiarity with branching strategies, pull requests and merge processes.

Responsibilities

• Build data pipelines that clean, transform, and aggregate data from disparate sources.
• Collaborate with stakeholders and other engineers.
• Contribute to the completion of milestones associated with your project.
• Contribute to continuous improvement within your team.
• Collaborate with your peers on technical direction within your team.

Skills

Agile delivery

PySpark

Apache Spark

Airflow

AWS

Azure

GCP

Kafka

SQL

NoSQL

Docker

Kubernetes

OpenShift

Data pipelines

ETL

Pandas

PyArrow

HDFS

S3

Tools

PySpark

Airflow

NI FI

Spark

Kafka

Docker

Kubernetes

OpenShift

Cloud services

Snowflake / data lake

Job description

Raytheon UK is seeking a Principal Data Engineer to build and maintain data pipelines and transform data for analytics within an Agile cross-functional team. The role focuses on clean, transform, and aggregate data from diverse sources while collaborating with stakeholders and engineers.

You’ll contribute to project milestones, drive continuous improvement, and help set technical direction within the team, on a UK-wide scale with a focus on national security data solutions.