Data Integration Developer

JD SPORTS FASHION; Manchester; Hybrid; GBP 100,000 - 125,000; Full time

Job summary

A leading retailer is seeking a Data Engineer to work in a hybrid role based in Manchester. The successful candidate will analyze large data sets using SQL and Python, set up new data pipelines, and maintain source code locations. This position offers a daily rate of £480 and a contract duration of 12 months. Ideal candidates will have strong problem-solving skills and experience with GCP and PySpark. This role is an opportunity to specialize in data engineering within a cloud-based environment.

Qualifications

• Strong experience with SQL and Python.
• 1-2 years of experience with cloud data solutions.
• Experience in PySpark or equivalent.

Responsibilities

• Analyze large data sets using tools such as Python & SQL.
• Set up new pipelines for stream/enrichment/curation processes.
• Maintain source code locations.

Skills

SQL

Python

Problem-solving

Stakeholder management

Tools

GCP

PySpark

Job description

Working with a wide array of tools, you will work through the full, streaming, enrichment & curation of data into a cloud-based data environment, verifying data, and making sure that links to other key data sets are obtained to allow for simple, effective data analysis for our insight team and data scientists. The role will allow you to start looking at whether you would like to become a specialist in a specific field, such as infrastructure, curation or ML/AI, in order to further progress your career. Assisting in the automation & maintenance of pipelines within a cloud-based environment, the candidate would also be involved in the sourcing of data using a range of different methods, whilst carrying out verification that the data is acceptable for ingestion.

Responsibilities

• Analysis of large data sets using tools such as Python & SQL
• Setting up new pipelines for the full stream/enrichment/curation process
• Upkeep of source code locations
• Creation of stream/enrichment/curation process utilising a wide variety of data sources
• Set up of tables/views/procedures
• Data aggregation & manipulation
• Building of large-scale analytical data sets
• Investigation of new/alternative technology solutions

Qualifications & Competencies

• Strong experience with SQL and Python
• Experience with cloud data solutions (e.g., GCP) and 1‑2 years of cloud data solution experience
• Experience in PySpark coding or equivalent
• Excellent problem‑solving skills and strong attention to detail
• Strong stakeholder management and communication skills
• Ability to decide on the overall concept and vision, and create road maps
• Competencies in planning, organizing, learning, researching, and networking (e.g., 4.2 Applying Expertise and Technology, 5.1 Learning and Researching)

Position: Data Engineer – Central Government (Inside IR35) Location: Hybrid - Manchester Salary: £480 per day Duration: 12 months