Principal Data Engineer: AI-Driven Cloud Data Architect

KPMG International Cooperative; Birmingham; Hybrid; GBP 90,000 - 130,000; Full time

Job summary

KPMG International Cooperative is seeking a Principal Data Engineer to shape the technical direction of data engineering within Technology & Solutions. You will lead enterprise-grade initiatives on the Databricks platform, with a strong emphasis on PySpark, SQL, Python, and Azure-based architectures.

You will champion modern engineering practices, including AI-assisted development, governance, and robust CI/CD delivery, while coaching teams to achieve excellence and collaboration across the

Qualifications

• Experience designing enterprise-scale data solutions on cloud platforms, with Databricks as core platform.
• Strong SQL, Python and PySpark for data transformation and pipeline development.
• Proven leadership, collaboration, and ability to guide teams through agile delivery cycles.

Responsibilities

• Design and deliver enterprise-scale data solutions on cloud platforms (Azure preferred), leveraging Databricks as the core data engineering platform.
• Build and optimize ETL/ELT pipelines using PySpark, SQL, and Python; orchestrate workflows via Databricks Workflows, Delta Live Tables, and ADF.
• Lead technical discovery with stakeholders and translate business needs into technical roadmaps.

Skills

Databricks

PySpark

SQL

Python

Azure

Delta Lake

Unity Catalog

CI/CD

Git

Data Governance

Leadership

Education

Bachelor's degree in Computer Science

Tools

Azure Data Factory

Power BI

Databricks Workflows

Delta Live Tables

Job description

KPMG International Cooperative is seeking a Principal Data Engineer to shape the technical direction of data engineering within Technology & Solutions. You will lead enterprise-grade initiatives on the Databricks platform, with a strong emphasis on PySpark, SQL, Python, and Azure-based architectures.

You will champion modern engineering practices, including AI-assisted development, governance, and robust CI/CD delivery, while coaching teams to achieve excellence and collaboration across the