Data Engineer - Cloud Pipelines & Analytics (Hybrid)

CACI Digital Experience (formerly Cyber-Duck); Bristol; Hybrid; GBP 70,000 - 90,000; Full time

Benefits offered by this job

Flexi-time: 37.5-hour weeks

Hybrid working: office or home

L&D: conferences and training

Job summary

CACI UK is seeking an experienced Data Engineer to join our Information Intelligence Group. You will design and maintain robust data pipelines and contribute to governance and security across public sector projects.

You will collaborate with clients to ensure data availability, accuracy and performance for analytics and operational decision-making, while shaping the data engineering roadmap and strategic direction.

Qualifications

• Proven experience as a Data Engineer in complex environments.
• Strong knowledge of data modelling, integration and governance.
• Experience with Snowflake and cloud data platforms.
• Familiarity with modern data architectures and security.
• Proficiency in SQL, Python and data pipeline tools.

Responsibilities

• Interpret and validate data requirements, gather and analyse large-scale structured datasets, and perform profiling within data environments to ensure accuracy and completeness.
• Design and implement ETL frameworks to ingest, transform, validate, normalise and cleanse data, ensuring it meets business and technical needs.
• Apply data quality controls and prepare datasets for visualisation, implementing data models and managing storage solutions such as Amazon S3, Azure Blob Storage, BigQuery or Snowflake.
• Support the development of data management standards and policies, including techniques for data synthesis and anonymisation to maintain compliance and security.
• Develop robust data models to support analytics and reporting within secure environments.
• Deliver performance optimisation through the monitoring and tuning of data workflows for speed, cost-efficiency and reliability.
• Establish and refine best practices in data engineering, while contributing to advanced analytics and visualisation strategies through research, evaluation of emerging technologies and presentation of findings to stakeholders.

Skills

SQL

Python

Data modelling

Data governance

Cloud platforms

Tools

Snowflake

BigQuery

Apache Airflow

Spark

AWS

Azure

GCP

Job description

CACI UK is seeking an experienced Data Engineer to join our Information Intelligence Group. You will design and maintain robust data pipelines and contribute to governance and security across public sector projects.

You will collaborate with clients to ensure data availability, accuracy and performance for analytics and operational decision-making, while shaping the data engineering roadmap and strategic direction.