Data engineer in cyber

Raytheon UK; Greater London; Hybrid; GBP 90,000 - 125,000; Full time

Benefits offered by this job

Contributory Pension Scheme up to 10.5

6x life assurance with pension

25 days holiday + public holidays + 5買

Company bonus scheme

Flexible Benefits scheme (Health Cash/

Enhanced sick pay

Enhanced family friendly policies

Early 1:30pm finish on Fridays

Remote, hybrid and site based working

Up to 5 paid volunteering days

Volunteer days and flexible working

Job summary

Raytheon UK ищет инженера данных для проектирования и поддержки конвейеров данных: очистка, трансформация и агрегация данных из различных источников. Вы будете сотрудничать с заинтересованными сторонами и инженерной командой, работать над достижением ключевых этапов проекта и участвовать в непрерывном улучшении процессов.

Роль требует опыта в управлении данными с использованием Spark, Airflow/NiFi, облачных сервисов и контейнеризации, а также владение SQL/NoSQL хранилищами и современными

Qualifications

• активное разрешение eDV для роли
• опыт работы в Agile-команде
• аналитические навыки с неструктурированными наборами данных
• Python (PySpark, Pandas, PyArrow)
• распределенная обработка данных (Apache Spark)
• ETL-работа (Airflow, AWS Step Functions, NiFi)
• облачные сервисы (AWS, Azure или GCP)
• сообщения/потоки (Kafka, AWS SQS и др.)
• SQL и NoSQL-хранилища (HDFS, Iceberg, Elastic, S3, Data Lake)
• контейнеризация и оркестрация (Docker/Kubernetes/OpenShift)
• тестовые фреймворки и лучшие практики
• использование репозиториев кода, ветки, PR и merge-процессы

Responsibilities

• Build data pipelines that clean, transform, and aggregate data from disparate sources
• Collaborate with stakeholders and other engineers
• Contribute to the completion of milestones associated with your project
• Contribute to continuous improvement within your team
• Collaborate with your peers on technical direction within your team

Skills

Agile delivery

Analytical skills

PySpark

Pandas

PyArrow

Apache Spark

ETL

Cloud services

Kafka

AWS SQS

SQL/NoSQL

Docker

Kubernetes

OpenShift

Testing frameworks

Git & PR workflows

Tools

Docker

Kubernetes

OpenShift

Airflow

NiFi

Spark

HDFS

Iceberg

Elastic

S3

Git

Job description

Описание

At Raytheon UK, we take immense pride in being a leader in defence and aerospace technology. As an employer, we are dedicated to fuelling innovation, nurturing talent, and fostering a culture of excellence.

Задачи

• Build data pipelines that clean, transform, and aggregate data from disparate sources
• Collaborate with stakeholders and other engineers
• Contribute to the completion of milestones associated with your project
• Contribute to continuous improvement within your team
• Collaborate with your peers on technical direction within your team

Требования

• we require all candidates to hold an active eDV clearance for this role.
• Experience of working in an Agile delivery team
• Strong analytic skills related to working with unstructured datasets
• Python (PySpark, Pandas, PyArrow)
• Distributed data processing (Apache Spark)
• Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi)
• Cloud services (AWS, Azure or GCP)
• Messaging / Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services)
• SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake)
• Containerisation and orchestration (Docker / Kubernetes / Openshift)
• Testing frameworks and best practices
• Use of Code repositories, familiarity with branching strategies, pull requests and merge processes

Условия

• £: Competitive salary
• Contributory Pension Scheme (up to 10.5% company contribution)
• 6 times salary ‘Life Assurance’ with pension
• 25 days holiday (increasing with service) + statutory public holidays, plus opportunity to buy and sell up to 5 days (37hr)
• Company bonus scheme (discretionary)
• Flexible Benefits scheme with extensive salary sacrifice schemes, including Health Cashplan, Dental, and Cycle to Work amongst others
• Enhanced sick pay
• Enhanced family friendly policies including enhanced maternity, paternity &shared parental leave 37hr working week, although hours may vary depending on role, job requirement or site-specific arrangements.
• Early 1.30pm finish Friday, start your weekend early!
• Remote, hybrid and site based working opportunities, dependant on your needs and the requirements of the role.
• Up to 5 paid days volunteering each year.
• Flexible working culture focused on output, with more formal flexible working arrangements on request (assessed subject to role) - please highlight any requests to the Talent Acquisition team.