Data Engineer

Brio Digital; Ledston; Hybrid; GBP 65,000 - 90,000; Full time

Job summary

Brio Digital is seeking an experienced Data Engineer to join a major data transformation programme on an initial 3-month contract. You will design, build and optimize cloud-based data solutions on AWS, creating trusted datasets for reporting and analytics.

You will collaborate with Data Architects, Analysts and Developers to translate business needs into scalable pipelines, data models and governance practices, with a strong emphasis on automation, CI/CD and monitoring.

Qualifications

• Proven experience designing and delivering AWS-based data platforms.
• Strong hands-on experience with AWS data services (S3, Redshift, Glue, Lambda, Lake Formation, Athena, EventBridge).
• Experience implementing Medallion Architecture (Bronze, Silver, Gold) and building ETL/ELT pipelines.

Responsibilities

• Design and build scalable data lake and data warehouse solutions on AWS.
• Develop data ingestion, transformation and storage pipelines to support reporting, analytics and operational use cases.
• Work with AWS services including S3, Redshift, Glue, Lambda, Lake Formation, Athena and EventBridge.
• Implement Bronze, Silver and Gold data layers using Medallion Architecture principles.
• Build and maintain ETL/ELT pipelines across batch, streaming and CDC workloads.
• Develop reusable transformation frameworks, data models and curated datasets using Python, SQL and dbt.
• Support data migration and integration activity across source and target systems.
• Build integrations using APIs, messaging technologies and file-based ingestion methods.
• Implement data validation, reconciliation and error-handling processes to improve data quality.
• Support data governance, lineage, security and audit requirements.
• Help automate deployments and infrastructure using Terraform or CloudFormation.
• Contribute to CI/CD pipelines using GitHub Actions or similar tooling.
• Improve monitoring and operational support using CloudWatch and Splunk.
• Produce clear technical documentation for pipelines, mappings, transformations and data flows.
• Promote good engineering practice, automation, standardisation and continuous improvement.

Skills

AWS data services

Python

SQL

dbt

ETL/ELT

Data governance

Data modelling

CI/CD

APIs & messaging

Terraform

CloudFormation

GitHub Actions

Monitoring

Data warehousing

Medallion Architecture

Tools

dbt

Terraform

CloudFormation

GitHub Actions

Splunk

CloudWatch

Job description

We are looking for an experienced Data Engineer to join a major data transformation programme on an initial 3-month contract.

This is a hands‑on role for someone who enjoys building robust, scalable data platforms and pipelines. You will work as part of a wider technical delivery team, helping to develop a modern AWS‑based data environment that supports enterprise reporting, analytics and operational decision‑making.

The successful candidate will ideally be able to attend the Leeds office one day per week. However, flexible arrangements can be discussed for the right person.

The role

You will play a key part in designing, building and improving cloud‑based data solutions. This will include developing data pipelines, integrating data from multiple systems and helping to create trusted, well‑governed datasets for reporting and analytics.

You will work closely with Data Architects, Analysts, Developers and other technical stakeholders to turn business and technical requirements into practical, scalable solutions.

Key responsibilities

• Design and build scalable data lake and data warehouse solutions on AWS.
• Develop data ingestion, transformation and storage pipelines to support reporting, analytics and operational use cases.
• Work with AWS services including S3, Redshift, Glue, Lambda, Lake Formation, Athena and EventBridge.
• Implement Bronze, Silver and Gold data layers using Medallion Architecture principles.
• Build and maintain ETL/ELT pipelines across batch, streaming and Change Data Capture (CDC) workloads.
• Develop reusable transformation frameworks, data models and curated datasets using Python, SQL and dbt.
• Support data migration and integration activity across a range of source and target systems.
• Build integrations using APIs, messaging technologies and file‑based ingestion methods.
• Implement data validation, reconciliation and error‑handling processes to improve data quality.
• Support data governance, lineage, security and audit requirements.
• Help automate deployments and infrastructure using Terraform or CloudFormation.
• Contribute to CI/CD pipelines using GitHub Actions or similar tooling.
• Improve monitoring and operational support using tools such as CloudWatch and Splunk.
• Produce clear technical documentation for pipelines, mappings, transformations and data flows.
• Promote good engineering practice, automation, standardisation and continuous improvement.

About you

You will be a capable, delivery‑focused Data Engineer with experience working on modern cloud data platforms. You should be comfortable working independently, but equally happy collaborating with a multidisciplinary technical team.

You will have strong experience with AWS data services and be confident designing and developing data pipelines in complex transformation, migration or integration environments.

Key skills and experience

• Proven experience designing and delivering AWS‑based data platforms.
• Strong hands‑on experience with services such as S3, Redshift, Glue, Lambda, Lake Formation, Athena and EventBridge.
• Experience implementing Medallion Architecture, including Bronze, Silver and Gold data layers.
• Strong data engineering experience across batch, streaming and CDC ingestion patterns.
• Advanced SQL skills and strong Python development experience.
• Experience using dbt for data transformation and modelling would be highly beneficial.
• Experience building and optimising ETL/ELT pipelines.
• Good understanding of data warehousing, dimensional modelling and analytical data structures.
• Experience with data integration, APIs, messaging and file‑based data ingestion.
• Knowledge of Terraform or CloudFormation for Infrastructure as Code.
• Experience with CI/CD tooling, ideally GitHub Actions.
• Experience with monitoring, observability and data quality frameworks.
• Knowledge of CloudWatch, Splunk or similar monitoring tools.
• An understanding of data governance, lineage, validation and security principles.
• Strong communication skills and the ability to work with both technical and non‑technical stakeholders.

Data Engineer • England, West Yorkshire, Leeds