AWS Data Engineer — Medallion Data Lake & ELT (Hybrid)

Brio Digital Limited; Leeds; Hybrid; GBP 65,000 - 101,000; Full time

Job summary

Brio Digital Limited in the United Kingdom is seeking an experienced Data Engineer to join a major data transformation programme on a 3‑month contract. The role is hands‑on, building robust, scalable data platforms and pipelines on AWS.

You will design data lakes and warehouses, ingest data from multiple systems, and support reporting, analytics and decision‑making with well‑governed datasets. Leeds office attendance is encouraged, with flexible arrangements.

Qualifications

• Proven experience designing and delivering AWS‑based data platforms.
• Hands-on with services such as S3, Redshift, Glue, Lambda, Lake Formation, Athena and EventBridge.
• Experience implementing Medallion Architecture, including Bronze, Silver and Gold data layers.
• Strong data engineering experience across batch, streaming and CDC ingestion patterns.
• Advanced SQL skills and strong Python development experience.
• Experience using dbt for data transformation and modelling would be highly beneficial.
• Experience building and optimising ETL/ELT pipelines.
• Good understanding of data warehousing, dimensional modelling and analytical data structures.
• Experience with data integration, APIs, messaging and file‑based data ingestion.
• Knowledge of Terraform or CloudFormation for Infrastructure as Code.
• Experience with CI/CD tooling, ideally GitHub Actions.
• Experience with monitoring, observability and data quality frameworks.
• Knowledge of CloudWatch, Splunk or similar monitoring tools.
• An understanding of data governance, lineage, validation and security principles.
• Strong communication skills and the ability to work with both technical and non‑technical stakeholders.

Responsibilities

• Design and build scalable data lake and data warehouse solutions on AWS.
• Develop data ingestion, transformation and storage pipelines to support reporting, analytics and operational use cases.
• Work with AWS services including S3, Redshift, Glue, Lambda, Lake Formation, Athena and EventBridge.
• Implement Bronze, Silver and Gold data layers using Medallion Architecture principles.
• Build and maintain ETL/ELT pipelines across batch, streaming and Change Data Capture (CDC) workloads.
• Develop reusable transformation frameworks, data models and curated datasets using Python, SQL and dbt.
• Support data migration and integration activity across a range of source and target systems.
• Build integrations using APIs, messaging technologies and file‑based ingestion methods.
• Implement data validation, reconciliation and error‑handling processes to improve data quality.
• Support data governance, lineage, security and audit requirements.
• Help automate deployments and infrastructure using Terraform or CloudFormation.
• Contribute to CI/CD pipelines using GitHub Actions or similar tooling.
• Improve monitoring and operational support using tools such as CloudWatch and Splunk.
• Produce clear technical documentation for pipelines, mappings, transformations and data flows.
• Promote good engineering practice, automation, standardisation and continuous improvement.

Skills

AWS data platforms

Python development

SQL

ETL/ELT pipelines

Data modeling

Data governance

CI/CD tooling

Communication skills

Tools

S3

Redshift

Glue

Lambda

Athena

Lake Formation

EventBridge

dbt

Terraform

CloudFormation

GitHub Actions

CloudWatch

Splunk

Job description

Brio Digital Limited in the United Kingdom is seeking an experienced Data Engineer to join a major data transformation programme on a 3‑month contract. The role is hands‑on, building robust, scalable data platforms and pipelines on AWS.

You will design data lakes and warehouses, ingest data from multiple systems, and support reporting, analytics and decision‑making with well‑governed datasets. Leeds office attendance is encouraged, with flexible arrangements.