Senior Data Engineer: Spark, PySpark & Azure

Aubay Portugal; Portugal; Híbrido; EUR 40 000 - 60 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Health Insurance

Feedback and Coffee system

Training Academy

Teambuilding events

Resumo da oferta

A multinational consultant in Portugal is seeking an experienced data engineer to design and implement data pipelines and optimize cloud services using Azure. The ideal candidate will have over 5 years of experience in data engineering, strong proficiency in Python, and familiarity with Apache Spark. This position offers a hybrid working model and the opportunity to work in a dynamic environment, contributing to a variety of sectors including banking and telecommunications.

Qualificações

• 5+ years of experience in data engineering roles.
• Advanced proficiency in Python and PySpark.
• Deep understanding of Apache Spark.
• Solid background in dimensional data modeling.

Responsabilidades

• Design and implement robust data pipelines.
• Develop data processing workflows using Apache Spark.
• Manage Azure cloud services.
• Support reporting needs through dashboards.

Conhecimentos

Data pipeline development

Python

Apache Spark

Azure Databricks

Data governance

Problem-solving

Communication skills

Ferramentas

Azure Data Factory

Apache Airflow

DevOps

Descrição da oferta de emprego

A multinational consultant in Portugal is seeking an experienced data engineer to design and implement data pipelines and optimize cloud services using Azure. The ideal candidate will have over 5 years of experience in data engineering, strong proficiency in Python, and familiarity with Apache Spark. This position offers a hybrid working model and the opportunity to work in a dynamic environment, contributing to a variety of sectors including banking and telecommunications.