Senior Data Platform Lead (Azure Databricks) - Contract

Microsoft Corporation; Atherstone; Hybrid; GBP 47,000 - 53,000; Full time

Job summary

Microsoft Corporation in Atherstone, England is seeking a senior data engineering contractor to modernize an existing Azure data platform. You will lead a Unity Catalog migration, redesign data orchestration, and drive platform reliability while actively participating in architecture reviews, code reviews, and delivery.

The role requires hands-on leadership with substantial Azure Databricks experience, strong SQL and Python skills, and a track record of reducing cloud costs.

Qualifications

• Must lead production-grade Azure data platforms.
• Experience delivering large migration or transformation projects.
• Ability improve performance, reliability and cloud costs.

Responsibilities

• Lead the technical delivery of a data platform modernization programme.
• Own the design and execution of Unity Catalog migration across key data domains.
• Define and implement modern orchestration patterns, replacing legacy workflows.
• Improve performance and reduce costs across Databricks clusters, Spark jobs, storage and scheduling.
• CI/CD and testing responsibilities.
• Monitoring, observability and incident management.
• Production readiness and review of architecture decisions.
• Mentor engineers and provide technical guidance.
• Collaborate with platform, analytics and business stakeholders.
• Deliver migrations with minimal business disruption.

Skills

SQL

Python

Cloud platform optimisation

Data platform migrations

Git and code review

CI/CD implementation

Monitoring and observability

Tools

Azure Databricks

Job description

Microsoft Corporation in Atherstone, England is seeking a senior data engineering contractor to modernize an existing Azure data platform. You will lead a Unity Catalog migration, redesign data orchestration, and drive platform reliability while actively participating in architecture reviews, code reviews, and delivery.

The role requires hands-on leadership with substantial Azure Databricks experience, strong SQL and Python skills, and a track record of reducing cloud costs.