Data Engineer - Azure & Databricks ETL Pipelines

QUANTEAM (RAINBOW PARTNERS Group); Lisboa; Presencial; EUR 25 000 - 61 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Health Insurance

Extra holiday: Christmas Eve or New Y1

Access to Quanteam Academy

Elevate Program

Consultant Expert support

Resumo da oferta

Quanteam, founding entity of RAINBOW PARTNERS, is seeking a Data Engineer to design and maintain scalable data pipelines using SQL, PySpark, Databricks and Azure.

You will collaborate with international teams to translate data requirements into robust ETL solutions, ensure data quality, and support data modelling and architecture efforts. Fluency in Portuguese and English is required, and based in Lisbon or Porto.

Qualificações

• 3+ years of professional experience as a Data Engineer.
• Strong experience with SQL.
• Hands-on experience with PySpark.
• Solid experience with Databricks.
• Good knowledge of Azure cloud technologies and services.
• Strong understanding of ETL processes and data integration.
• Experience with Data Modelling and data architecture concepts.
• Strong analytical and problem-solving skills.
• Ability to work effectively in a collaborative and international environment.
• Fluency in Portuguese and English, both written and spoken.

Responsabilidades

• Design, develop and maintain scalable data pipelines and ETL processes.
• Develop and optimize data processing solutions using SQL and PySpark.
• Build and manage data solutions using Databricks.
• Work with Microsoft Azure cloud services to develop and maintain data platforms.
• Perform data transformation, integration and processing from multiple sources.
• Contribute to data modelling and the design of efficient data structures.
• Ensure data quality, consistency, reliability and performance across data solutions.
• Troubleshoot and optimize existing data pipelines and processes.
• Collaborate with technical and business teams to understand data requirements and deliver effective solutions.

Conhecimentos

SQL

PySpark

Databricks

Azure

ETL

Data modelling

Data architecture

Analytical

Teamwork

Portuguese

English

Ferramentas

Databricks

Descrição da oferta de emprego

Quanteam, founding entity of RAINBOW PARTNERS, is seeking a Data Engineer to design and maintain scalable data pipelines using SQL, PySpark, Databricks and Azure.

You will collaborate with international teams to translate data requirements into robust ETL solutions, ensure data quality, and support data modelling and architecture efforts. Fluency in Portuguese and English is required, and based in Lisbon or Porto.