Data engineer in the public sector

G Digital; Greater London; On-site; GBP 54,000 - 66,000; Full time

Job summary

G Digital ищет Data Engineer для работы с государственными клиентами в Лондоне. В обязанности входит разработка и внедрение конвейеров данных для поддержки аналитики, ML и бизнес-интеллигенса в гибридной/локальной инфраструктуре.

Требуется опыт работы с Spark, Python, SQL, Kafka и Airflow, а также готовность к прохождению проверки безопасности. Описание роли связано с обеспечением соответствия требованиям и защите данных.

Qualifications

• Security clearance required or eligible to obtain clearance.
• Ability to identify data sources and implement ETL/ELT pipelines.
• Experience designing on-premise, cloud-based and hybrid data solutions.
• Data modelling and data flows for analytics and BI.

Responsibilities

• Develop and implement data engineering pipelines for public sector projects.
• Collaborate with project teams to support data science and mission intelligence use cases.
• Ensure data security and compliance across data systems.

Skills

ETL/ELT concepts

Data pipelines

Python

SQL

Apache Spark

Kafka

Airflow

Tools

Apache Spark

Kafka

Airflow

Cloud ETL services

Python

SQL

Job description

Описание

I am currently partnering with a rapidly growing, values-driven team of specialists who work with government clients across Cyber, Telecommunications, Defence and Data. They are seeking a talented and motivated Data Engineer to join the team, protecting the UK through data-driven insights and solutions based at Head office in London.

Задачи

The purpose of the role is to work closely with public sector clients and project teams to develop and implement data engineering pipelines to support data science and business/mission intelligence use cases.

Требования

• Security clearance is required - eligibility/willing to undergo security clearance
• Identifying data sources, data extraction, transformation, and loading (ETL/ELT) concepts and methods
• Designing, evaluating, and implementing on-premise, cloud-based and hybrid data engineering solutions
• Modelling, structuring and storing data along with their data flows for uses including analytics, machine learning, data mining, compliance and business intelligence
• You have worked in client delivery across a range of projects, including data analysis, extraction, transformation, and loading, data intelligence, data security and proven experience in their technologies (e.g. Spark, cloud-based ETL services, Python, Kafka, SQL, Airflow)

Условия

Salary: Up to 60k + Matched 5% Pension, Training Budget and more…