Data Engineer — Azure & Databricks, Scale Data Pipelines

PSD Group; Barcelona; On-site; EUR 42,000 - 68,000; Full time

Job summary

PSD Group is partnered with a global technology organisation at the heart of the air transport industry, seeking a Data Engineer with up to 5 years' experience to join the Central Data Team. You will work across data landscapes to enable analytics, ML, and AI use cases on a Databricks and Azure platform.

You will collaborate with data engineers, data architects, data scientists and business stakeholders to design and implement scalable data solutions, contributing to the organisation's data

Qualifications

• 2 to 5+ years' experience in data engineering or closely related Big Data environments.
• Hands-on experience with Python and SQL, including clean coding and object-oriented programming practices.
• Experience with Databricks and Apache Spark.
• Practical experience developing and maintaining data pipelines and ETL/ELT processes.
• Experience with cloud data platforms, ideally Microsoft Azure.

Responsibilities

• Design and implement scalable data solutions on a centrally managed Databricks and Azure platform.
• Collaborate with data engineers, data architects, data scientists and business stakeholders to enable analytics, ML and AI use cases.

Skills

Python

SQL

ETL/ELT

Tools

Databricks

Apache Spark

Microsoft Azure

Job description

PSD Group is partnered with a global technology organisation at the heart of the air transport industry, seeking a Data Engineer with up to 5 years' experience to join the Central Data Team. You will work across data landscapes to enable analytics, ML, and AI use cases on a Databricks and Azure platform.

You will collaborate with data engineers, data architects, data scientists and business stakeholders to design and implement scalable data solutions, contributing to the organisation's data