Data Engineer: Scalable Fabric Platform & CI/CD

Uniserve Group; City Of London; On-site; GBP 60,000 - 80,000; Full time

Job summary

A leading technology firm in the UK is seeking an experienced Data Engineer to design, build, and optimize their enterprise data platform. The ideal candidate will have expertise in Microsoft Fabric, data engineering, and strong programming skills in Python and Spark. This role offers competitive salary and various benefits including a pension scheme, discretionary bonus, and career development opportunities.

Benefits

Competitive Salary

Discretionary Bonus

Pension Scheme

Annual Salary Review

Free Eye Test and Vouchers

Interest-Free Company Loan

Free On-Site Parking

Cycle to work scheme

Referral Bonus £750

Care First Lifestyle Programme

Flu Jabs Annually

Life Assurance

Electric Vehicle Charging Points

Flexible Career Pathway

Supply Chain Academy Education Courses

Qualifications

• Proven experience in data engineering with expertise in Microsoft Fabric or similar cloud platforms.
• Advanced proficiency in Python, Spark, and Scala for data processing and pipelines.
• Strong understanding of Medallion Architecture, Delta Lake, and distributed data systems.
• Experience with Spark performance tuning and optimisation.
• Solid knowledge of data governance, lineage, and metadata management.
• Familiarity with CI/CD pipelines, Git, and DevOps practices.

Responsibilities

• Design scalable data architectures using Microsoft Fabric.
• Build and optimise complex data pipelines.
• Develop reusable data models and curated datasets.
• Write modular code following best practices.
• Implement and enforce data governance standards.
• Drive adoption of CI/CD and DevOps practices.

Skills

Data engineering

Python programming

Spark

Scala

Medallion Architecture

Data governance

CI/CD practices

Problem-solving

Communication skills

Education

Relevant qualifications or certifications (e.g., DP-203, CDMP, DGCP, Masters)

Tools

Microsoft Fabric

Job description

A leading technology firm in the UK is seeking an experienced Data Engineer to design, build, and optimize their enterprise data platform. The ideal candidate will have expertise in Microsoft Fabric, data engineering, and strong programming skills in Python and Spark. This role offers competitive salary and various benefits including a pension scheme, discretionary bonus, and career development opportunities.