Data Engineer- CONTRACT ROLE

Clearwater People Solutions; Basingstoke; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A leading company in the UK is seeking a Data Engineer for a 6-month assignment to design and implement data ingestion pipelines. The ideal candidate will have strong experience with Azure Databricks and a solid background in SQL and Python, contributing to project success in a hybrid work environment.

Qualifications

• Solid experience with Azure Databricks.
• Proficiency in writing SQL.
• Strong experience in SQL and Python.

Responsibilities

• Implementing data products for insights and informed decisions.
• Designing and implementing performant data ingestion pipelines.
• Collaborating with the data team on API interfaces and data models.

Skills

Azure Databricks

SQL

Python

Data Management Principles

Apache Spark

Job description

Our client, Clearwater People Solutions, is currently recruiting for a Data Engineer on a 6-month basis to design and implement data ingestion pipelines. The Data Engineer must have solid experience with Azure Databricks and have worked within a regulated environment previously.

This position offers a pay rate of £450-£500 per day outside of IR35. It is a hybrid role with 2-3 days in the office in Basingstoke.

Key responsibilities and requirements for the Data Engineer:

• Supporting stakeholders by implementing data products for insights and informed decisions.
• Designing and implementing performant data ingestion pipelines from multiple sources using Apache Spark, preferably in Azure Databricks.
• Delivering and presenting proofs of concept for key technology components to the data team and project stakeholders.
• Integrating end-to-end data pipelines to ensure data quality and consistency from source systems to target repositories.
• Collaborating with the data team and broader business to support additional project components such as API interfaces, data models, data sharing, and ML endpoints.
• Proficiency in writing SQL.
• Strong experience in SQL and Python.
• Good knowledge of Data Management principles within a Lakehouse Architecture.