Databricks Data Platform Lead: Resilience & Incidents

Solution Performance Resourcing Limited; United Kingdom; Sur place; GBP 95 000 - 130 000; Plein temps

Résumé du poste

SPG Resourcing is seeking a Senior Data Platform Lead to own and improve a live data environment in the UK. You will drive incident diagnosis, recovery, and platform resilience while leading hands-on work across PySpark, Delta Lake, and Databricks Workflows.

In this high-impact role you will collaborate with ERP data sources, manage production changes, and evolve runbooks for operational readiness in a 17x5 support model.

Qualifications

• Lead incidents and diagnose data-flow interruptions across ERP to downstream applications.
• Own platform health, monitoring, performance, cost optimisation and resilience.
• Hands-on leadership with PySpark, Spark SQL, Delta Lake and Databricks Workflows.

Responsabilités

• Lead technical diagnosis and recovery when incidents affect data flowing from ERP systems through ingestion, Azure storage and Databricks to downstream applications.
• Own platform health, monitoring, performance, cost optimisation and operational resilience.
• Provide hands-on leadership across PySpark, Spark SQL, Delta Lake and Databricks Workflows.
• Set standards for Unity Catalog, access controls, data lineage and production releases.
• Work with engineering, application, service management and vendor teams to resolve complex issues and prevent recurrence.
• Improve runbooks, recovery procedures and architecture documentation.
• Transfer knowledge to the wider team and support operational readiness.
• Participate in a 17x5 support model, with the working pattern confirmed during the briefing process.

Connaissances

PySpark

Spark SQL

Delta Lake

Databricks Workflows

Azure Databricks

ADLS Gen2

Azure DevOps

Git

CI/CD

Data flow troubleshooting

ERP data integration

JD Edwards

Oracle ERP

SAP

Dynamics

Incident leadership

Qlik Replicate

CDC

Supply chain data

Outils

Azure DevOps

Git

CI/CD pipelines

Description du poste

SPG Resourcing is seeking a Senior Data Platform Lead to own and improve a live data environment in the UK. You will drive incident diagnosis, recovery, and platform resilience while leading hands-on work across PySpark, Delta Lake, and Databricks Workflows.

In this high-impact role you will collaborate with ERP data sources, manage production changes, and evolve runbooks for operational readiness in a 17x5 support model.