Cloud Data Pipeline Engineer (SQL/Python)

JD GROUP; Bury; On-site; GBP 40,000 - 60,000; Full time

Job summary

A cloud-based data solutions company in the United Kingdom is seeking a skilled Data Engineer to work with various tools for data curation in a cloud environment. In this role, you will analyze large data sets, automate pipelines, and collaborate with stakeholders. Applicants should have 1-2 years of experience in cloud data solutions and proficiency in SQL and Python. Strong problem-solving and communication skills are essential. This position offers an opportunity for career progression in specialized fields such as ML/AI.

Qualifications

• Excellent level of experience in tools such as SQL and Python.
• 1-2 years of cloud data solution experience in GCP or Azure.
• Experience of Pyspark coding or equivalent.

Responsibilities

• Assist in the automation and maintenance of pipelines in a cloud-based environment.
• Analyze large data sets using tools such as Python and SQL.
• Set up new pipelines for the stream/enrichment/curation process.

Skills

SQL

Python

Pyspark

Problem solving

Stakeholder management

Communication

Tools

GCP

Azure

Job description

A cloud-based data solutions company in the United Kingdom is seeking a skilled Data Engineer to work with various tools for data curation in a cloud environment. In this role, you will analyze large data sets, automate pipelines, and collaborate with stakeholders. Applicants should have 1-2 years of experience in cloud data solutions and proficiency in SQL and Python. Strong problem-solving and communication skills are essential. This position offers an opportunity for career progression in specialized fields such as ML/AI.