Role overview
Design, build, and operate production data pipelines and analytical products on an Azure-based data platform. The role spans new reporting workloads and improvements to existing pipelines, with responsibility for reliability, performance, monitoring, incident response, and operational documentation.
Responsibilities
- Create, test, deploy, and maintain scalable pipelines for reporting and analytics.
- Refactor existing pipelines to improve reliability, performance, maintainability, and observability.
- Work with data, architecture, product, and engineering colleagues to turn reporting needs into robust solutions.
- Onboard data workloads to the platform and align them with architecture, governance, security, and engineering standards.
- Own operational practices for data pipelines, diagnose failures, identify root causes, and implement lasting fixes.
- Document data flows, dependencies, transformations, and operating procedures; share practices that support team autonomy.
Requirements
- At least eight years of data engineering experience, including ownership of production-grade pipelines.
- Strong hands-on experience with Microsoft Azure and Databricks.
- Advanced SQL and Python skills, with experience building and operating data pipelines and analytical data products.
- Understanding of modern data platform and lakehouse approaches, including medallion architecture and dimensional modelling.
- Experience with software engineering and DataOps practices such as version control, automated testing, CI/CD, monitoring, and incident management.
- SRE experience, strong data modelling judgement, clear documentation, and ability to work autonomously across teams.
Nice to have
- Databricks governance, lineage, and access-control experience, including Unity Catalog.
- Experience with payment or transaction data, or in distributed international teams.