Data Engineer

HGF Limited; Leeds; On-site; GBP 60,000 - 90,000; Full time

Benefits offered by this job

27 days holiday

Bonus scheme

Flexible working

Enhanced parental leave policy

Job summary

HGF Limited is creating a brand-new data engineering role to build and run the technical foundation of its data strategy. You will pull data from core business systems into a Lakehouse on Microsoft Fabric, process it through a medallion architecture, and deliver modeled, trusted data for reporting and AI.

You will work in the Data team reporting to the Head of Data, collaborating with Analysts, IT and Security on secure integration.

Qualifications

• Commercial data engineering experience (4+ years).
• SQL (4+ years).
• Python and PySpark (3+ years).
• Microsoft Fabric or an equivalent Azure data platform (2+ years).
• Medallion / layered lakehouse architecture (2+ years).
• Dimensional data modelling for analytics (2+ years).
• Building and maintaining production data pipelines (3+ years).
• Azure DevOps, including source control and CI/CD practices (2+ years).
• MDM and entity resolution tools such as Aptitude or Senzing (2+ years).

Responsibilities

• Build and maintain scalable data pipelines from core systems and third-party sources.
• Design and develop data solutions with Python, PySpark, SQL, notebooks and dataflows across a medallion architecture.
• Create and optimise data models powering Power BI reporting and analytics.
• Implement data quality, validation and reconciliation processes.
• Monitor, troubleshoot and keep the platform fast, reliable and available.
• Configure master data management and entity resolution for cross-system consistency.
• Own MDM approach including golden records, matching, de-duplication and survivorship rules.

Skills

SQL

Python

PySpark

Azure Fabric

Medallion Architecture

Dimensional Modelling

Data Pipelines

Azure DevOps

MDM/Entity Resolution

Tools

Aptitude

Senzing

Azure DevOps

Microsoft Fabric

Job description

This is a brand-new role, created to build and run the technical foundation of HGF’s data strategy. You’ll bring data from our source systems into our Lakehouse on Microsoft Fabric, process it through a medallion architecture, and deliver modelled, trusted data that’s ready for reporting, AI and machine learning.

You’ll sit in our Data team reporting to the Head of Data, working with our Data Analysts on modelling, and with IT, Information Security and system owners on secure integration. It’s a small team and a genuine build role, which means real influence over the architecture, the tooling and the standards we adopt.

As the data platform grows so will the role and there’s scope to move into advanced analytics, and AI-assisted tooling such as Fabric MCP, Fabric IQ, Copilot and data agents.

Key Responsibilities

• Building and maintaining scalable data pipelines, pulling data in from core business systems and third-party sources.
• Designing and developing data solutions with Python, PySpark, SQL, notebooks and dataflows across a modern medallion architecture (Bronze, Silver, Gold).
• Creating and optimising data models that power high-quality Power BI reporting and analytics.
• Putting data quality, validation and reconciliation processes in place so the numbers can be trusted.
• Monitoring, troubleshooting and keeping the platform fast, reliable and available.
• Configuring and supporting master data management and entity resolution, so data stays consistent across systems.
• Owning our master data management approach defining golden records for clients, contacts and matters, setting matching, de-duplication and survivorship rules, and using entity resolution tooling such as Aptitude or Senzing to link records across systems.
• Owning source control, code reviews and CI/CD pipelines through Azure DevOps.
• Implementing secure, compliant data access role-based security, auditing and governance controls.
• Keeping technical documentation, data lineage and platform standards in good order.
• Helping shape where the platform goes next, including future analytics, AI and machine learning capability.

Candidate Essential Experience, Qualifications and Skills

• Commercial data engineering experience (4+ years)
• SQL (4+ years)
• Python and PySpark (3+ years)
• Microsoft Fabric or an equivalent Azure data platform (2+ years)
• Medallion / layered lakehouse architecture (2+ years)
• Dimensional data modelling for analytics (2+ years)
• Building and maintaining production data pipelines (3+ years)
• Azure DevOps, including source control and CI/CD practices (2+ years)
• Master Data Management (MDM) and entity resolution tools such as Aptitude or Senzing (2+ years)

This is a mid to senior level role. We don’t expect every box ticked if you’re close, get in touch.

About You

You’re an experienced Data Engineer who knows Microsoft Fabric or the Azure data stack well, and you’ve built, optimised and supported pipelines that people actually depend on. Python, PySpark and SQL are comfortable territory, and you’ve designed lakehouse architectures that hold up under real business intelligence workloads.

You’re a proactive problem-solver who works methodically and delivers to a high standard, with data quality, security and platform reliability built into everything you do. You can talk to technical and non-technical colleagues just as easily, and you enjoy an environment where collaboration, ownership and continuous improvement genuinely matter. Experience with master data management, data governance, Azure security or real-time data solutions would be a real bonus.

About HGF:

HGF Limited is one of Europe’s largest intellectual property specialist firms offering a fully integrated IP solution, bringing over 200 Patent Attorneys, Trade Mark Attorneys and IP Solicitors together to provide a full-service IP solution.

With 25 offices across the UK, Ireland, Germany, Netherlands, France, Switzerland & Austria, HGF’s Patent and Trade Mark Attorneys provide specialist technical and legal advice to blue chip organisations and small to medium businesses across the world. Many of our clients are household names and the work HGF does allows them to protect and exploit their inventions, new products and branding.

Why move to HGF?

• HGF takes a transparent and merit-based approach to your career development and you will have the opportunity to shape your long-term progression.
• We’re a firm with a focus on DEI (Diversity, Equality and Inclusion), with a staff led DEI Focus Group, affinity networks and a DEI Board sponsor
• As a business we have a dedicated Learning and Development team focused on career long development of your skills along with a digital learning platform covering a wide range of content
• Benefits including our award winning enhanced parental leave policy, 27 days holiday, bonus scheme and flexible working

HGF Values

People - People matter. We treat people fairly, with respect and compassion. We foster a friendly, inclusive and enjoyable culture for everyone to prosper in. We invest in our people and offer appropriate coaching and training to assist with development and learning. We promote a healthy work-life balance. Progression is based on merit.

Excellence – We strive to be the best. We pursue excellence in all our individual roles resulting in outstanding legal and technical advice for our clients. Our people are pragmatic, responsive and commercially minded. We do not presume but listen to understand so we can engage proactively and appropriately.

Teamwork – We stand together. We work with our clients to protect their interests, and with each other as a mutually supporting firm. We value, appreciate and listen to others, regardless of role, recognising each individual’s particular blend of talent, skill and experience. We are individually and jointly accountable and take responsibility for our actions and decisions.

Progressive – We innovate. We continually improve our services and processes through understanding, creativity, and investment. We evolve by taking opportunities and adopting new business procedures, unencumbered by historical structures or out-of-date attitudes. As a firm, we have an entrepreneurial spirit, and encourage new thinking in our people.