Data Engineer: Microsoft Fabric & Lakehouse (UK)

TXP; Birmingham; On-site; GBP 65,000 - 95,000; Full time

Benefits offered by this job

25 days annual leave

Birthday leave

4% matched pension

Life assurance 3x

Private medical insurance

Employee Assistance Programme

Octopus EV Scheme

Cycle to work scheme

Social value days

Job summary

TXP, a UK data consultancy, is seeking a Data Engineer to join its Data & AI Practice. You will design, build and own production-grade data pipelines using Microsoft Fabric and Azure, powering analytics, decision-making and AI initiatives for a diverse client portfolio.

Collaborate with Data Architects, Engineers and Scientists on large-scale transformations, including public sector and regulated industry projects, with a focus on quality, governance and engineering discipline.

Qualifications

• Strong SQL skills with complex queries and performance tuning.
• Hands-on PySpark experience for large-scale transformations.
• Experience with lakehouse architectures and cloud data platforms.
• Familiarity with Delta Lake, Parquet formats and modern data engineering practices.
• Git-based development and CI/CD pipelines.

Responsibilities

• Design, build and support end-to-end data solutions using Microsoft Fabric and Azure.
• Develop scalable batch and incremental data pipelines.
• Optimize PySpark notebooks for large-scale data transformation.
• Create robust Lakehouse and Warehouse solutions within OneLake.
• Write performant SQL for analytics and reporting.
• Implement data quality, validation and governance controls.
• Build CI/CD pipelines and support deployments across environments.
• Collaborate with client stakeholders to shape data solutions.

Skills

SQL proficiency

PySpark

Lakehouse architectures

Delta Lake

Parquet

Git

CI/CD

Azure DevOps

Azure Cloud

Client communication

Tools

Azure

GitHub

OneLake

Fabric

Job description

TXP, a UK data consultancy, is seeking a Data Engineer to join its Data & AI Practice. You will design, build and own production-grade data pipelines using Microsoft Fabric and Azure, powering analytics, decision-making and AI initiatives for a diverse client portfolio.

Collaborate with Data Architects, Engineers and Scientists on large-scale transformations, including public sector and regulated industry projects, with a focus on quality, governance and engineering discipline.