Data Platform Engineer (Lead II - Data Engineering)

UST; Leeds; Hybrid; GBP 90,000 - 120,000; Full time

Job summary

UST is seeking a Data Platform Lead Engineer to guide the design, delivery, and evolution of a cloud-based data platform. You will provide technical leadership, shape architecture, and align engineering teams with business goals to deliver scalable, secure data solutions.

Based in West Yorkshire with hybrid work (3 days onsite), the role requires strong Databricks and Azure expertise, Terraform proficiency, and outstanding communication with both technical and non-technical stakeholders.

Qualifications

• Experience with Databricks development and platform architecture.
• Strong knowledge of Azure infrastructure, networking, and Terraform.
• Proven track record in solution architecture, design, and stakeholder management.
• Experience leading technical teams across multiple workstreams.
• Excellent communication with technical and non-technical stakeholders.
• Self-motivated and proactive with minimal supervision.
• Exposure to Power BI and Power Automate.
• Experience in Agile delivery environments.

Responsibilities

• Lead the architecture, design, and implementation of Azure- and Databricks-based data platforms.
• Provide technical leadership, mentoring, and guidance to engineering teams.
• Collaborate with business and technical stakeholders to define platform roadmaps and best practices.
• Ensure platform scalability, reliability, security, and operational excellence.
• Drive adoption of Infrastructure as Code and DevOps practices using Terraform and Azure services.
• Support strategic decision-making by aligning platform capabilities with business objectives.

Skills

Databricks development

Azure infrastructure

Terraform

Solution architecture

Stakeholder management

Team leadership

Communication skills

Power BI

Power Automate

Agile delivery

Self-motivated

Tools

Databricks

Azure networking

Terraform

Job description

Data Platform Lead Engineer

Role Description

We are seeking an experienced Data Platform Lead to drive the design, delivery, and evolution of a modern cloud-based data platform. You will provide technical leadership, shape platform architecture, engage with key stakeholders, and guide engineering teams in delivering scalable, secure, and high-performing data solutions.

Location: West Yorkshire-Multiple locations (Hybrid - 3 days onsite, mandatory)

Employment Type: Permanent | Fixed-Term Contract | Contract (Inside IR35)

Start Date: Immediate

Key Responsibilities

• Lead the architecture, design, and implementation of Azure and Databricks-based data platforms.
• Provide technical leadership, mentoring, and guidance to engineering teams.
• Collaborate with business and technical stakeholders to define platform roadmaps and best practices.
• Ensure platform scalability, reliability, security, and operational excellence.
• Drive adoption of Infrastructure as Code and DevOps best practices using Terraform and Azure services.
• Support strategic decision-making by aligning platform capabilities with business objectives.

Essential Skills & Experience

• Strong hands-on experience with Databricks development and platform architecture.
• Good understanding of Azure infrastructure, networking, and Terraform.
• Proven experience in solution architecture, technical design, and stakeholder management.
• Experience leading technical teams and driving delivery across multiple workstreams.
• Excellent communication skills with both technical and non-technical stakeholders.
• Self-motivated, proactive, and able to operate with minimal supervision
• Exposure to Power BI and Power Automate.
• Experience working within Agile delivery environments.

Key Requirements

• Strong technical leadership and stakeholder engagement capabilities.
• Ability to manage workload independently and drive initiatives proactively.
• Experience designing and supporting enterprise-scale cloud data platforms.

Skills

ETL, Power Automate, Power BI, PySpark