Data Engineer

Change Digital – Digital & Tech Recruitment; Greater London; Hybrid; GBP 65,000 - 90,000; Full time

Job summary

Change Digital – Digital & Tech Recruitment is seeking an experienced Data Engineer to design and build modern cloud data platforms. You will own end-to-end data pipelines, governance and BI delivery in a hybrid role with office days in London or other UK cities.

You’ll work with Databricks, Spark, Python, SQL and Azure, delivering scalable data solutions while driving automation and CI/CD practices across the data stack.

Qualifications

• Minimum 3+ years of data engineering experience across cloud platforms.
• Strong background in designing modern data platforms and scalable pipelines.
• Hands-on data modelling, governance and security best practices.

Responsibilities

• Design, build and maintain cloud-based data platforms and DW solutions.
• Develop and optimise ETL/ELT pipelines using Databricks, Spark, SQL and Python.
• Create and manage CI/CD pipelines to automate deployments.
• Implement Infrastructure as Code using Terraform and cloud-native tooling.
• Design scalable data models for reporting and analytics requirements.
• Manage platform security, access controls, metadata and governance standards.
• Build integrations with external systems, APIs and cloud services.
• Support BI dashboards and analytics delivery.
• Collaborate with stakeholders to deliver scalable data solutions.
• Drive automation, testing and continuous improvement across data and platform services.

Skills

Databricks

Spark

Python

SQL

Azure

Terraform

CI/CD

Data warehousing

Data governance

dbt

Power BI

API integration

Tools

GitHub

Azure DevOps

dbt Cloud

Job description

We are looking for an experienced Data Engineer to join my clients growing team. This role is ideal for an engineer who enjoys designing modern data platforms, building scalable cloud solutions, and automating deployments through DevOps best practices.

You will work across the full data lifecycle, from platform architecture and data engineering through to analytics, reporting, governance, and cloud optimisation. The role requires a strong technical background combined with the ability to deliver practical solutions that drive business value.

The role is hybrid working with 3 days from home and 2 days from the local office (Edinburgh, London, Manchester, Birmingham or Leeds) or with client.

Sponsorship is not available for this role.

Key Responsibilities

• Design, build and maintain modern cloud-based data platforms and data warehouse solutions.
• Develop and optimise ETL/ELT pipelines using Databricks, Spark, SQL and Python.
• Create and manage CI/CD pipelines to automate deployments and improve engineering productivity.
• Implement Infrastructure as Code using Terraform and cloud-native tooling.
• Design and maintain scalable data models that support operational and strategic reporting requirements.
• Manage platform security, access controls, metadata and data governance standards.
• Build integrations with external systems, APIs and cloud services.
• Support the development and delivery of BI dashboards and analytics solutions.
• Collaborate with business and technical stakeholders to define and deliver scalable data solutions.
• Drive automation, testing and continuous improvement across data and platform services.
• Strong experience in Data Engineering
• Advanced SQL and Python development skills.
• Hands-on experience with Databricks, Spark and PySpark.
• Experience with Azure cloud technologies, including Azure Data Factory and Microsoft Fabric.
• CI/CD pipeline development using GitHub and Azure DevOps.
• Knowledge of data warehouse architecture, governance and security best practices.
• Power BI, Tableau and enterprise reporting solutions.
• dbt and dbt Cloud.
• Power Apps and Power Automate.
• API development and integration experience.