Hybrid Data Platform Engineer — Cloud, Databricks & ETL

Change Digital – Digital & Tech Recruitment; City of Edinburgh; Hybrid; GBP 65,000 - 90,000; Full time

Job summary

Change Digital – Digital & Tech Recruitment is hiring an experienced Data/Platform Engineer to design modern cloud data platforms, build scalable pipelines and automate deployments.

You will cover the full data lifecycle from architecture to analytics, governance and cloud optimisation, working hybrid from the UK with offices in Edinburgh or elsewhere. Strong SQL, Python and Databricks skills are essential.

Qualifications

• Extensive experience designing modern data platforms and data warehouses.
• Strong SQL and Python development skills across analytics, reporting and governance.
• Proven ability to architect cloud-based data solutions with scalable pipelines and governance.

Responsibilities

• Design, build and maintain modern cloud-based data platforms and data warehouse solutions.
• Develop and optimise ETL/ELT pipelines using Databricks, Spark, SQL and Python.
• Create and manage CI/CD pipelines to automate deployments and improve engineering productivity.
• Implement Infrastructure as Code using Terraform and cloud-native tooling.
• Design and maintain scalable data models that support operational and strategic reporting requirements.
• Manage platform security, access controls, metadata and data governance standards.
• Build integrations with external systems, APIs and cloud services.
• Support the development and delivery of BI dashboards and analytics solutions.
• Collaborate with business and technical stakeholders to define and deliver scalable data solutions.
• Drive automation, testing and continuous improvement across data and platform services.
• Strong experience in Data Engineering, Platform Engineering and Data Modelling.
• Advanced SQL and Python development skills.
• Hands-on experience with Databricks, Spark and PySpark.
• Experience with Azure cloud technologies, including Azure Data Factory and Microsoft Fabric.
• CI/CD pipeline development using GitHub and Azure DevOps.
• Infrastructure as Code using Terraform.
• Experience with PostgreSQL, SQL Server or other enterprise database platforms.
• Knowledge of data warehouse architecture, governance and security best practices.
• Experience working within Agile delivery environments.
• Power BI, Tableau and enterprise reporting solutions.
• dbt and dbt Cloud.
• Power Apps and Power Automate.
• API development and integration experience.

Skills

Data platform design

Cloud data engineering

SQL

Python

CI/CD

Terraform

Data governance

Agile delivery

BI reporting

Stakeholder collaboration

Data modelling

Tools

Databricks

Spark

PySpark

GitHub

Azure DevOps

Azure Data Factory

Microsoft Fabric

dbt Cloud

PostgreSQL

SQL Server

Power BI

Tableau

Terraform

Job description

Change Digital – Digital & Tech Recruitment is hiring an experienced Data/Platform Engineer to design modern cloud data platforms, build scalable pipelines and automate deployments.

You will cover the full data lifecycle from architecture to analytics, governance and cloud optimisation, working hybrid from the UK with offices in Edinburgh or elsewhere. Strong SQL, Python and Databricks skills are essential.