Data Engineer

Uniserve Group; City Of London; On-site; GBP 60,000 - 80,000; Full time

Job summary

A leading technology firm in the UK is seeking an experienced Data Engineer to design, build, and optimize their enterprise data platform. The ideal candidate will have expertise in Microsoft Fabric, data engineering, and strong programming skills in Python and Spark. This role offers competitive salary and various benefits including a pension scheme, discretionary bonus, and career development opportunities.

Benefits

Competitive Salary

Discretionary Bonus

Pension Scheme

Annual Salary Review

Free Eye Test and Vouchers

Interest-Free Company Loan

Free On-Site Parking

Cycle to work scheme

Referral Bonus £750

Care First Lifestyle Programme

Flu Jabs Annually

Life Assurance

Electric Vehicle Charging Points

Flexible Career Pathway

Supply Chain Academy Education Courses

Qualifications

• Proven experience in data engineering with expertise in Microsoft Fabric or similar cloud platforms.
• Advanced proficiency in Python, Spark, and Scala for data processing and pipelines.
• Strong understanding of Medallion Architecture, Delta Lake, and distributed data systems.
• Experience with Spark performance tuning and optimisation.
• Solid knowledge of data governance, lineage, and metadata management.
• Familiarity with CI/CD pipelines, Git, and DevOps practices.

Responsibilities

• Design scalable data architectures using Microsoft Fabric.
• Build and optimise complex data pipelines.
• Develop reusable data models and curated datasets.
• Write modular code following best practices.
• Implement and enforce data governance standards.
• Drive adoption of CI/CD and DevOps practices.

Skills

Data engineering

Python programming

Spark

Scala

Medallion Architecture

Data governance

CI/CD practices

Problem-solving

Communication skills

Education

Relevant qualifications or certifications (e.g., DP-203, CDMP, DGCP, Masters)

Tools

Microsoft Fabric

Job description

The Vacancy

Uniserve is seeking an experienced Data Engineer to join our team and play a pivotal role in designing, building, and optimising our enterprise data platform using Microsoft Fabric. This is a high-impact role for someone passionate about building scalable, secure, and high-performance data solutions that enable advanced analytics and data-driven decision-making across the organisation.

Key Responsibilities

• Design and implement scalable data architectures using Microsoft Fabric (Lakehouse, OneLake, Spark, Delta Lake).
• Build and optimise complex data pipelines across the Medallion Architecture for analytics-ready data.
• Develop reusable data models, semantic layers, and curated datasets for enterprise-wide use.
• Write production-grade code in Python, SQL, and Scala, following best practices for modularity, testing, and performance.
• Implement and enforce data governance, lineage, and metadata standards (Microsoft Purview).
• Drive adoption of CI/CD, version control, and DevOps practices for data engineering workflows.
• Monitor and resolve performance bottlenecks in Spark jobs and large-scale queries.
• Collaborate with architects, analysts, and business leaders to align data solutions with strategic goals.
• Evaluate and introduce new tools, frameworks, and patterns for scalability and maintainability.
• Contribute to platform reliability, cost optimisation, and security using architectural best practices.

Skills & Experience

• Proven experience in data engineering with expertise in Microsoft Fabric or similar cloud platforms.
• Advanced proficiency in Python, Spark, and Scala for data processing and pipelines.
• Strong understanding of Medallion Architecture, Delta Lake, and distributed data systems.
• Experience with Spark performance tuning and optimisation.
• Solid knowledge of data governance, lineage, and metadata management (Microsoft Purview preferred).
• Familiarity with CI/CD pipelines, Git, and DevOps practices.
• Ability to design and implement reusable data models and semantic layers.
• Excellent problem-solving and troubleshooting skills.
• Strong communication skills with technical and non-technical stakeholders.
• Relevant qualifications or certifications (e.g., DP-203, CDMP, DGCP, Masters in a related field) are advantageous.

Benefits

• Competitive Salary: We value your skills and commitment.
• Discretionary Bonus: Because your hard work deserves to be rewarded.
• Pension Scheme: We've got your future covered.
• Annual Salary Review: Your growth matters to us.
• Free Eye Test and up to £69 Vouchers towards Glasses: Taking care of your vision.
• Interest-Free Company Loan: We're here to support you.
• Free On-Site Parking: Convenient and hassle-free.
• Cycle to work scheme
• Referral Bonus £750: Spread the word and earn some extra cash.
• Care First Lifestyle Programme: Because your well-being matters.
• Flu Jabs Annually: Stay healthy, on us!
• Life Assurance: We've got you covered.
• Electric Vehicle Charging Points at Work: Embrace sustainable transport.
• Flexible Career Pathway.
• Supply Chain Academy Education Courses: Expand your knowledge through our Apprenticeships and Commercial Courses.