Data Engineer – 11943HS

Proactive IT; West of England; Hybrid; GBP 74,000 - 83,000; Full time

Job summary

Proactive Appointments Ltd. is seeking an experienced Data Engineer for a contract role in the UK.

The position focuses on building data matching pipelines, cleansing and standardising customer data, and tuning matching models to create accurate master customer records across multiple systems. You will work with Microsoft Fabric, PySpark and Splink, implement data quality controls, and deliver master customer records across systems.

Qualifications

• Experience building and supporting data pipelines in a cloud data platform, ideally Microsoft Fabric.
• Strong Python, including pandas and PySpark.
• Strong SQL, including Spark SQL or T-SQL.
• Experience cleaning and standardising data
• Experience matching, deduplicating or reconciling records across systems, whether rule-based or probabilistic.
• Understanding of how to measure data quality and match accuracy, including false positives and missed matches.
• Good working knowledge of UK GDPR and handling personal data securely.
• Use of version control (Git) and writing readable, documented, tested code.
• Ability to explain technical decisions and trade-offs clearly to non-technical colleagues.

Responsibilities

• Develop data matching pipelines and cleanse and standardise customer data.
• Tune matching models and build accurate master customer records across systems.
• Collaborate with team and explain technical trade-offs.

Skills

Microsoft Fabric

PySpark

Splink

Python

Pandas

SQL

Git

Data Cleansing

Data Matching

Tools

Spark SQL

T-SQL

Job description

11943HS
£400 – 450 per day + Outside IR35

Data Engineer

Contract – Outside IR35 | £400-£450 per day | 6 Weeks Initial Contract Length | Remote (Initial 2-3 days on-site to kick start the project)

Our client is looking for an experienced Data Engineer with strong Microsoft Fabric, PySpark and Splink experience. You’ll be responsible for developing data matching pipelines, cleansing and standardising customer data, tuning matching models and building accurate master customer records across multiple systems.

• Experience building and supporting data pipelines in a cloud data platform, ideally Microsoft Fabric.
• Strong Python, including pandas and PySpark.
• Strong SQL, including Spark SQL or T-SQL.
• Experience cleaning and standardising data
• Experience matching, deduplicating or reconciling records across systems, whether rule-based or probabilistic.
• Understanding of how to measure data quality and match accuracy, including false positives and missed matches.
• Good working knowledge of UK GDPR and handling personal data securely.
• Use of version control (Git) and writing readable, documented, tested code.
• Ability to explain technical decisions and trade-offs clearly to non-technical colleagues.

Due to the volume of applications received for positions, it will not be possible to respond to all applications and only applicants who are considered suitable for interview will be contacted.

Proactive Appointments Limited operates as an employment agency and employment business and is an equal opportunities organisation

We take our obligations to protect your personal data very seriously. Any information provided to us will be processed as detailed in our Privacy Notice, a copy of which can be found on our website http://proactive.it/privacy-notice/