Principal Data Engineer

Raytheon Systems; City of Westminster; Hybrid; GBP 65,000 - 95,000; Full time

Benefits offered by this job

Competitive salary

Pension scheme

Life assurance

25 days holiday

Bonus scheme

Flexible benefits

Enhanced sick pay

Family friendly policies

Job summary

Raytheon UK is seeking a Principal Data Engineer to build and maintain data pipelines and transform data for analytics within an Agile cross-functional team. The role focuses on clean, transform, and aggregate data from diverse sources while collaborating with stakeholders and engineers.

You’ll contribute to project milestones, drive continuous improvement, and help set technical direction within the team, on a UK-wide scale with a focus on national security data solutions.

Qualifications

• Experience in an Agile delivery team.
• Strong analytics with unstructured data.
• Python (PySpark, Pandas, PyArrow).
• Distributed data processing (Apache Spark).
• Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi).
• Cloud services (AWS, Azure or GCP).
• Messaging / Streaming (Kafka, AWS SQS).
• SQL and NoSQL.
• Storage (HDFS, Iceberg, Elastic, S3, Data Lake).
• Containerisation and orchestration (Docker / Kubernetes / Openshift).
• Testing frameworks and best practices.
• Use of Code repositories, familiarity with branching strategies, pull requests and merge processes.

Responsibilities

• Build data pipelines that clean, transform, and aggregate data from disparate sources.
• Collaborate with stakeholders and other engineers.
• Contribute to the completion of milestones associated with your project.
• Contribute to continuous improvement within your team.
• Collaborate with your peers on technical direction within your team.

Skills

Agile delivery

PySpark

Apache Spark

Airflow

AWS

Azure

GCP

Kafka

SQL

NoSQL

Docker

Kubernetes

OpenShift

Data pipelines

ETL

Pandas

PyArrow

HDFS

S3

Tools

PySpark

Airflow

NI FI

Spark

Kafka

Docker

Kubernetes

OpenShift

Cloud services

Snowflake / data lake

Job description

You'll be part of our experienced Software Engineering function, working in a cross-functional Agile team. The Principal Data Engineer role will be responsible for building and maintaining data processing pipelines and also the transformation and optimisation of data for analytical use.

• Build data pipelines that clean, transform, and aggregate data from disparate sources
• Collaborate with stakeholders and other engineers
• Contribute to the completion of milestones associated with your project
• Contribute to continuous improvement within your team
• Collaborate with your peers on technical direction within your team

Requirements/knowledge (you don't need everything)

• Experience of working in an Agile delivery team
• Strong analytic skills related to working with unstructured datasets
• Python (PySpark, Pandas, PyArrow)
• Distributed data processing (Apache Spark)
• Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi)
• Cloud services (AWS, Azure or GCP)
• Messaging / Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services)
• SQL and NoSQL
• Storage (HDFS, Iceberg, Elastic, S3, Data Lake)
• Containerisation and orchestration (Docker / Kubernetes / Openshift)
• Testing frameworks and best practices
• Use of Code repositories, familiarity with branching strategies, pull requests and merge processes

We appreciate you may not be an expert in every area above - we can support with training and development in some areas!

At Raytheon UK, we take immense pride in being a leader in defence and aerospace technology. As an employer, we are dedicated to fuelling innovation, nurturing talent, and fostering a culture of excellence. As a leading defence and aerospace company operating across the United Kingdom, Raytheon UK helps to solve our customers' toughest challenges. We are a major supplier to the UK government and customers around the globe, providing defence solutions across all domains: land, sea, air, space, and cyberspace. We also provide digital and training transformation solutions to commercial and military customers. With circa 2000 employees and major facilities operating throughout the UK including Broughton (Wales), Livingston and Glenrothes (Scotland), and Harlow, Gloucester, and Manchester (England); we are committed to investing in British careers and technology development. Cyber Our National Security Cyber business delivers mission-critical solutions that safeguard our national security 24 hours a day, seven days a week. Working in a mature, agile environment, our SCRUM teams work synchronously with our customers to solve some of the toughest digital challenges faced in the world today.

• £: Competitive salary
• Contributory Pension Scheme (up to 10.5% company contribution)
• 6 times salary 'Life Assurance' with pension
• 25 days holiday (increasing with service) + statutory public holidays, plus opportunity to buy and sell up to 5 days (37hr)
• Company bonus scheme (discretionary)
• Flexible Benefits scheme with extensive salary sacrifice schemes, including Health Cashplan, Dental, and Cycle to Work amongst others
• Enhanced sick pay
• Enhanced family friendly policies including enhanced maternity, paternity & shared parental leave

Work Culture

• 37hr working week, although hours may vary depending on role, job requirement or site-specific arrangements.
• Early 1.30pm finish Friday, start your weekend early!
• Remote, hybrid and site based working opportunities, dependant on your needs and the requirements of the role.
• Up to 5 paid days volunteering each year.
• Flexible working culture focused on output, with more formal flexible working arrangements on request (assessed subject to role) - please highlight any requests to the Talent Acquisition team.