Azure Data Engineer (Fabric & Cloud Data Platform)

Pace Industries, LLC; Greater London; Hybrid; GBP 61,000 - 81,000; Full time

Job summary

Rackspace Technology is seeking an Azure Data Engineer to design, build, and maintain our enterprise data platform. You will implement a modern lakehouse architecture on Microsoft Fabric and Azure Databricks, with strict encryption, logging, auditing, and fine-grained access controls for identifiable data.

Location: on-site with a customer in Central London. You will work on data lakehouse design, data zone management, scalable batch processing with Spark-based pipelines, and security governance

Qualifications

• 3+ years of dedicated hands-on experience in Microsoft Azure, with practical exposure to the Microsoft Fabric ecosystem (OneLake, Data Factory, Fabric Lakehouse).
• Deep technical expertise with Apache Spark / Azure Databricks for distributed compute, memory optimization, and Delta Lake formats.
• Advanced proficiency in SQL (T-SQL, SparkSQL) and Python (PySpark).
• Direct experience implementing security controls for sensitive or identifiable data, utilizing Azure Key Vault, Azure Monitor, Log Analytics, and Microsoft Purview.
• Proven track record of migrating, refactoring, or connecting legacy SQL/stored procedure logic and existing pipelines into modern cloud formats.

Responsibilities

• Data Lakehouse Architecture: design and optimize a high-performance lakehouse pattern utilizing Microsoft Fabric OneLake and Azure Data Lake Storage Gen2 (ADLS Gen2).
• Data Zone Management: Maintain architectural segregation between raw storage (immutability, landing) and curated data zones (cleansed, conformed business layers) while securely handling identifiable data.
• Scalable Data Processing: Develop, tune, and monitor large-scale batch processing pipelines using Azure Databricks (Spark-based processing) and PySpark.
• Orchestration & Workflow: Build automated data workflows using Microsoft Fabric Data Factory and Azure Data Factory to move data efficiently across the platform.
• Legacy & Model Integration: Ensure seamless integration with existing data pipelines, legacy data models, and established transformation logic without breaking downstream analytical operations.
• Platform Security & Governance: Implement enterprise-grade security baselines including data-at-rest/in-transit encryption, structured logging, automated audit trails, and strict access controls (RBAC, ABAC, and row/column-level security).
• Future-Proof Analytics: Structure data foundations to readily support future analytical workloads, advanced reporting, and data science use cases.

Skills

Azure

Fabric OneLake

Azure Data Factory

Azure Databricks

PySpark

SQL (T-SQL, SparkSQL)

Python

RBAC/ABAC

Tools

Terraform

Bicep

Git/Azure DevOps

Job description

Company Overview

Rackspace Technology™ is a leading end-to-end, hybrid cloud and AI solutions company. We can design, build, and operate our customers' cloud environments across all major technology platforms, irrespective of technology stack or deployment model. We partner with our customers at every stage of their cloud journey, enabling them to modernize applications, build new products, and adopt innovative technologies. Named a best place to work by Newsweek and Forbes, we attract and develop world-class talent to deliver a Fanatical Experience™ – so our customers can achieve better outcomes and stay ahead of what’s next.

Job Summary

We are seeking a highly skilled Azure Data Engineer to design, build, and maintain our enterprise data platform. In this role, you will implement a modern data lakehouse architecture capable of supporting raw and curated data zones, scalable batch processing, and future analytical workloads. You will play a key role in integrating our existing data pipelines, models, and transformation logic into a unified ecosystem built on Microsoft Fabric and Azure Databricks. A heavy emphasis is placed on enforcing strict encryption, comprehensive logging, auditing, and fine-grained access controls to secure identifiable data. Location: on-site with a customer in Central London.

Key Responsibilities

• Data Lakehouse Architecture: Design and optimize a high-performance lakehouse pattern utilizing Microsoft Fabric OneLake and Azure Data Lake Storage Gen2 (ADLS Gen2).
• Data Zone Management: Maintain architectural segregation between raw storage (immutability, landing) and curated data zones (cleansed, conformed business layers) while securely handling identifiable data.
• Scalable Data Processing: Develop, tune, and monitor large-scale batch processing pipelines using Azure Databricks (Spark-based processing) and PySpark.
• Orchestration & Workflow: Build automated data workflows using Microsoft Fabric Data Factory and Azure Data Factory to move data efficiently across the platform.
• Legacy & Model Integration: Ensure seamless integration with existing data pipelines, legacy data models, and established transformation logic without breaking downstream analytical operations.
• Platform Security & Governance: Implement enterprise-grade security baselines including data-at-rest/in-transit encryption, structured logging, automated audit trails, and strict access controls (RBAC, ABAC, and row/column-level security).
• Future-Proof Analytics: Structure data foundations to readily support future analytical workloads, advanced reporting, and data science use cases.

Required Technical Skills

• Cloud Platform & Fabric: 3+ years of dedicated hands-on experience in Microsoft Azure, with practical exposure to the Microsoft Fabric ecosystem (OneLake, Data Factory, Fabric Lakehouse).
• Big Data Processing: Deep technical expertise with Apache Spark / Azure Databricks for distributed compute, memory optimization, and Delta Lake formats.
• Data Engineering Languages: Advanced proficiency in SQL (T-SQL, SparkSQL) and Python (PySpark).
• Security & Compliance: Direct experience implementing security controls for sensitive or identifiable data, utilizing Azure Key Vault, Azure Monitor, Log Analytics, and Microsoft Purview.
• Data Integration: Proven track record of migrating, refactoring, or connecting legacy SQL/stored procedure logic and existing pipelines into modern cloud formats.

Preferred Qualifications & Certifications

• Certifications: Microsoft Certified: Azure Data Engineer Associate (DP-203) or Microsoft Certified: Fabric Analytics Engineer Associate (DP-600) is highly advantageous.
• DevOps/IaC: Experience deploying data infrastructure as code using Terraform, Bicep, and managing deployments via Git/Azure DevOps.

Soft Skills

• Exceptional analytical and root-cause debugging skills for distributed Spark jobs and multi-stage pipelines.
• Ability to collaborate with compliance and security teams to validate data privacy baselines.
• Strong communication skills to bridge technical delivery with business intelligence requirements.

Compensation

Our compensation reflects the cost of labor across several geographic markets. The compensation range for this position ranges from £61,079.00/year in our lowest geographic market up to £81,370.00/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Your recruiter can share more about the specific salary range for your preferred location during the hiring process. The compensation package may also include incentive compensation opportunities in the form of annual bonus or incentives, equity awards and an Employee Stock Purchase Plan (ESPP).

Benefits

Learn more about benefits at Rackspace.

About Rackspace Technology

We are the multicloud solutions experts. We combine our expertise with the world’s leading technologies — across applications, data and security — to deliver end-to-end solutions. We have a proven record of advising customers based on their business challenges, designing solutions that scale, building and managing those solutions, and optimizing returns into the future. Named a best place to work, year after year according to Fortune, Forbes and Glassdoor, we attract and develop world-class talent. Join us on our mission to embrace technology, empower customers and deliver the future. More on Rackspace Technology.

Company Culture & Diversity

Though we’re all different, Rackers thrive through our connection to a central goal: to be a valued member of a winning team on an inspiring mission. We bring our whole selves to work every day. And we embrace the notion that unique perspectives fuel innovation and enable us to best serve our customers and communities around the globe.

Equal Employment Opportunity

We welcome you to apply today and want you to know that we are committed to offering equal employment opportunity without regard to age, color, disability, gender reassignment or identity or expression, genetic information, marital or civil partner status, pregnancy or maternity status, military or veteran status, nationality, ethnic or national origin, race, religion or belief, sexual orientation, or any legally protected characteristic. If you have a disability or special need that requires accommodation, please let us know.

Core Values

Embrace Technology. Empower Customers. Deliver the Future.

Company Excellence

Excellence: We’re an accountable, disciplined, high-performing company with proven results. Customer-driven: We’re proactive, collaborative and committed to success for our customers, communities and each other. Expertise: We’re passionate learners, rooted in our customers’ business to provide unbiased solutions. Agility: We’re adopting new technologies and evolving services to meet customers where they are in their journey. Compassion: We’re one team, doing the right thing for our customers, communities and each other. We’re looking for team members who are ready to unleash their creativity, collaborate with talented coworkers and make a lasting impact in the IT field. Could that be you?