Azure Data Engineer: Lakehouse & Secure Pipelines

Webhosting; Greater London; Hybrid; GBP 85,000 - 120,000; Full time

Job summary

Rackspace Technology is seeking a highly skilled Azure Data Engineer to design, build, and maintain our enterprise data platform, implementing a modern data lakehouse on Fabric and Azure Databricks, with emphasis on security, logging, and access controls.

The role focuses on integrating existing pipelines, designing raw and curated zones, and ensuring robust encryption and governance to support analytics and data science, with on-site work in Central London.

Qualifications

• Experience building data lakehouse architectures on Azure Fabric and Databricks.
• Strong SQL and PySpark development skills.
• Experience with encryption, auditing, and access controls.

Responsibilities

• Design and optimize lakehouse architecture using Fabric OneLake and ADLS Gen2.
• Develop and tune large-scale batch pipelines with Azure Databricks.
• Orchestrate data workflows with Fabric Data Factory and Azure Data Factory.
• Ensure data security, logging, auditing, and RBAC/ABAC controls.
• Migrate legacy data pipelines into modern cloud formats.

Skills

Azure Data Engineering

Data Lakehouse Architecture

SQL

Python / PySpark

Security & Compliance

Tools

Azure Databricks

Fabric OneLake

Data Factory

ADLS Gen2

Microsoft Purview

Azure Key Vault

Job description

Rackspace Technology is seeking a highly skilled Azure Data Engineer to design, build, and maintain our enterprise data platform, implementing a modern data lakehouse on Fabric and Azure Databricks, with emphasis on security, logging, and access controls.

The role focuses on integrating existing pipelines, designing raw and curated zones, and ensuring robust encryption and governance to support analytics and data science, with on-site work in Central London.