AWS Data Engineer – Power BI

Scrumconnect Consulting; Lancashire; On-site; GBP 53,000 - 93,000; Full time

Job summary

Scrumconnect Consulting is seeking an experienced DevOps Engineer – Data Engineer in the UK to design and maintain scalable data pipelines in AWS and build Power BI dashboards and semantic models. You will work across data integration, governance, and analytics to deliver robust data platforms.

The role requires 4+ years in Data Engineering/DevOps/DataOps with strong Power BI development and production support experience.

Qualifications

• Strong Power BI experience and dashboard development
• Hands-on AWS services and data platform experience
• Data Engineering, DataOps or DevOps background
• Excellent SQL and data modelling skills
• Experience building ETL/ELT pipelines
• Knowledge of data warehousing concepts
• CI/CD and source control practices
• Proficiency with Git-based workflows

Responsibilities

• Design, develop and maintain scalable data pipelines and ETL/ELT processes
• Build and manage data solutions using native AWS services
• Develop and maintain Power BI dashboards, reports, semantic models and datasets
• Integrate data from multiple sources into AWS-based platforms
• Implement CI/CD pipelines for data and analytics deployments
• Automate infrastructure and data engineering processes
• Monitor pipelines and Power BI refreshes in production
• Troubleshoot data quality, deployment and pipeline issues
• Implement data validation, monitoring, logging and alerting
• Collaborate with developers, analysts and business teams to gather requirements
• Follow DevOps/DataOps best practices for version control, automation and release management
• Support continuous improvement of data platforms and reporting solutions

Skills

Power BI

SQL

Data Engineering

CI/CD

DevOps

Git

Python

AWS

Data warehousing

ETL/ELT

Tools

GitHub

GitLab

Terraform

Docker

Kubernetes

Airflow

MWAA

Databricks

Spark

dbt

CloudFormation

Job description

Salary: £53,000 - 93,000 per year

Requirements

• Strong hands-on Power BI experience.
• Strong hands-on experience with native AWS services.
• Experience in Data Engineering / DataOps.
• Strong SQL skills.
• Experience building ETL/ELT data pipelines.
• Experience with data modelling and data warehousing.
• Experience with CI/CD and DevOps practices.
• Experience with Git and source-code management.
• Strong troubleshooting and problem-solving skills.
• Practical experience with AWS data services such as Amazon S3, AWS Glue, Amazon Redshift, AWS Lambda, Amazon Athena, Amazon RDS, AWS IAM, and Amazon CloudWatch.
• Experience with services such as Kinesis, EMR, Step Functions, or MWAA/Airflow would be advantageous.
• Power BI Desktop and Power BI Service experience.
• Dashboard and report development experience.
• Data modelling and relationships experience.
• DAX and Power Query experience.
• Dataset and semantic model development experience.
• Power BI deployment and refresh management experience.
• Row-Level Security (RLS) experience.
• Performance optimisation experience.
• Integration of Power BI with cloud/data platforms.
• CI/CD pipelines experience.
• Experience with Git/GitHub/GitLab.
• Infrastructure as Code experience such as Terraform or CloudFormation.
• Automated deployments across environments experience.
• Monitoring and logging experience.
• Release and configuration management experience.
• Production support and incident troubleshooting experience.
• Python or another scripting language is desirable.
• AWS certification is desirable.
• Terraform is desirable.
• Docker/Kubernetes is desirable.
• Apache Airflow / MWAA is desirable.
• Databricks or Spark is desirable.
• Kafka/Kinesis is desirable.
• dbt is desirable.
• Experience working in Agile/Scrum environments is desirable.
• 4+ years of experience in Data Engineering, DevOps, DataOps, or a closely related role.
• Proven experience delivering data solutions in AWS.
• Strong Power BI development and production support experience.
• Experience working with enterprise data platforms and cloud environments.
• Candidates must have both strong Power BI experience and hands-on native AWS experience.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT processes.
• Build and manage data solutions using native AWS services.
• Develop and maintain Power BI dashboards, reports, semantic models, and datasets.
• Integrate data from multiple sources into AWS-based data platforms.
• Implement CI/CD pipelines for data and analytics deployments.
• Automate infrastructure and data engineering processes.
• Monitor data pipelines, Power BI refreshes, and production environments.
• Troubleshoot pipeline failures, data quality issues, and deployment problems.
• Implement data validation, monitoring, logging, and alerting.
• Work with development, analytics, and business teams to understand requirements.
• Follow DevOps and DataOps best practices around version control, automation, testing, and release management.
• Support continuous improvement of data platforms and reporting solutions.

Technologies

• Airflow
• AWS
• AWS Glue
• Lambda
• Redshift
• CI/CD
• Cloud
• CloudWatch
• Databricks
• DAX
• DevOps
• Docker
• ETL
• Git
• GitHub
• GitLab
• IAM
• Support
• Kafka
• Kubernetes
• Power BI
• Power Query
• Python
• SQL
• Security
• Spark
• Terraform
• dbt
• Business Intelligence

More

We are Scrumconnect Consulting, a multi-award-winning UK public sector digital consultancy positively influencing the lives of over forty million UK citizens. We bring deep expertise in agile delivery, digital transformation, and platform engineering across central government. Our team includes over one hundred and twenty-five professionals, with more than forty percent women, and we are committed to building inclusive, diverse teams that reflect the communities we serve. We are looking for an experienced DevOps Engineer – Data Engineer with strong hands-on experience in Power BI and native AWS services to build, automate, deploy, and support scalable data solutions and analytics platforms. We also believe that diversity drives innovation and welcome applications from candidates of all backgrounds, including women, people with disabilities, underrepresented communities, and those seeking flexible working arrangements.

last updated 38 week of 2026