Senior Data Platform Engineer: Azure DevOps & Lakehouse

Edgefolio; Greater London; Hybrid; GBP 90,000 - 140,000; Full time

Job summary

Edgefolio is seeking a Senior Data Engineer to transform our analytics stack into a modern Azure-based platform with CI/CD and IaC. You will mentor the team, design scalable pipelines, and drive governance and security across the data estate.

You’ll work with PostgreSQL/SQL Server, build Lakehouse patterns, and partner with product teams to deliver real-time insights and automated data products.

Qualifications

• Strong experience with Azure data stack and modern data platforms.
• Proficient in Python and SQL for ELT/ETL pipelines.
• Experience in CI/CD, IaC and DevOps practices.
• Knowledge of data governance, GDPR and security best practices.
• Ability to mentor and lead data platform initiatives.

Responsibilities

• Architect a modern Azure-based data platform with DevOps at its core.
• Build automated, self-service data pipelines and CI/CD for analytics.
• Lead migration from legacy systems to a scalable lakehouse.
• Collaborate with product teams, analysts and engineers to align data capabilities.
• Document architectures, runbooks and training materials.

Skills

Azure

Python

SQL

Delta Lake

Databricks

Synapse

CI/CD

Terraform

Kubernetes

Azure DevOps

Goverance & Security

Tools

Azure DevOps

GitHub Actions

Terraform

Kubernetes

Databricks

Job description

Edgefolio is seeking a Senior Data Engineer to transform our analytics stack into a modern Azure-based platform with CI/CD and IaC. You will mentor the team, design scalable pipelines, and drive governance and security across the data estate.

You’ll work with PostgreSQL/SQL Server, build Lakehouse patterns, and partner with product teams to deliver real-time insights and automated data products.