Data Engineer

Brio Digital; Leeds; Hybrid; GBP 60,000 - 90,000; Full time

Job summary

Brio Digital is seeking a Data Engineer to design and implement data pipelines on AWS, delivering curated datasets for Power BI and potentially Microsoft Fabric. The role focuses on extracting from DynamoDB and CloudWatch, transforming and aggregating data, and building scalable pipelines.

You will work with stakeholders to translate reporting requirements into robust data models and measures, ensuring data quality, governance and security across projects.

Qualifications

• Proven experience in data engineering and ETL development.
• Hands-on AWS experience with DynamoDB and CloudWatch.
• Experience with Power BI and building data pipelines.
• Knowledge of GDPR, NHS information governance and data minimisation."

Responsibilities

• Extract data from DynamoDB, CloudWatch and other AWS sources.
• Design and implement data transformation, cleansing and aggregation.
• Develop reusable data pipelines using AWS services.
• Create curated datasets and data models for Power BI and Microsoft Fabric.
• Support the development and maintenance of Power BI reports and dashboards.
• Collaborate with stakeholders to translate reporting requirements into data models and measures.

Skills

Data engineering

ETL development

Data pipelines

Power BI

Data governance

GDPR knowledge

Tools

DynamoDB

CloudWatch

S3

Glue

Athena

Lambda

Firehose

Microsoft Fabric

Azure

Job description

• Location: Fully remote but rare, occasional need in Leeds

Overview

We're looking for a Data Engineer to design and implement data extraction, transformation and aggregation pipelines to support Product reporting. The role will primarily work with AWS data sources, including DynamoDB and CloudWatch, and deliver curated datasets to Power BI and potentially Microsoft Fabric.

Key Responsibilities

• Extract data from DynamoDB, CloudWatch and other AWS data sources
• Design and implement data transformation, cleansing and aggregation processes
• Develop efficient and reusable data pipelines using appropriate AWS services
• Create curated datasets and data models suitable for Power BI and Microsoft Fabric
• Support the development and maintenance of Power BI reports and dashboards
• Work with stakeholders to understand reporting requirements and translate them into appropriate data models and measures

Key Requirements

• Strong experience in data engineering and ETL development
• Hands-on experience with AWS, particularly DynamoDB and CloudWatch
• Experience working with Power BI
• Experience building and maintaining data pipelines
• Understanding of data quality, governance and security
• Experience with Microsoft Fabric and/or Azure
• Experience with AWS services such as S3, Glue, Athena, Lambda and Firehose
• Experience working with operational/observability data from CloudWatch
• Understanding of GDPR, NHS information governance and data minimisation principles