Data Engineer - Azure & Databricks (Lisbon or Porto)

QUANTEAM (RAINBOW PARTNERS Group); Lisboa; Presencial; EUR 25 000 - 61 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Health Insurance

Extra holiday: Christmas Eve or New Y1

Access to Quanteam Academy

Elevate Program

Consultant Expert support

Resumo da oferta

Quanteam, founding entity of RAINBOW PARTNERS, is seeking a Data Engineer to design and maintain scalable data pipelines using SQL, PySpark, Databricks and Azure.

You will collaborate with international teams to translate data requirements into robust ETL solutions, ensure data quality, and support data modelling and architecture efforts. Fluency in Portuguese and English is required, and based in Lisbon or Porto.

Qualificações

• 3+ years of professional experience as a Data Engineer.
• Strong experience with SQL.
• Hands-on experience with PySpark.
• Solid experience with Databricks.
• Good knowledge of Azure cloud technologies and services.
• Strong understanding of ETL processes and data integration.
• Experience with Data Modelling and data architecture concepts.
• Strong analytical and problem-solving skills.
• Ability to work effectively in a collaborative and international environment.
• Fluency in Portuguese and English, both written and spoken.

Responsabilidades

• Design, develop and maintain scalable data pipelines and ETL processes.
• Develop and optimize data processing solutions using SQL and PySpark.
• Build and manage data solutions using Databricks.
• Work with Microsoft Azure cloud services to develop and maintain data platforms.
• Perform data transformation, integration and processing from multiple sources.
• Contribute to data modelling and the design of efficient data structures.
• Ensure data quality, consistency, reliability and performance across data solutions.
• Troubleshoot and optimize existing data pipelines and processes.
• Collaborate with technical and business teams to understand data requirements and deliver effective solutions.

Conhecimentos

SQL

PySpark

Databricks

Azure

ETL

Data modelling

Data architecture

Analytical

Teamwork

Portuguese

English

Ferramentas

Databricks

Descrição da oferta de emprego

Quanteam, founding entity of RAINBOW PARTNERS, is a consulting firm specialized in Banking and Financial Services. With more than 1200 consultants across 10 countries, we combine business and IT expertise to support leading institutions in transformation projects.

Our core areas:

Operations & Finance

We are looking for a Data Engineer - Azure & Databricks

Are you passionate about Data, Cloud and modern technologies? This opportunity might be for you!

• Design, develop and maintain scalable data pipelines and ETL processes.
• Develop and optimize data processing solutions using SQL and PySpark.
• Build and manage data solutions using Databricks.
• Work with Microsoft Azure cloud services to develop and maintain data platforms.
• Perform data transformation, integration and processing from multiple sources.
• Contribute to data modelling and the design of efficient data structures.
• Ensure data quality, consistency, reliability and performance across data solutions.
• Troubleshoot and optimize existing data pipelines and processes.
• Collaborate with technical and business teams to understand data requirements and deliver effective solutions.
• 3+ years of professional experience as a Data Engineer.
• Strong experience with SQL.
• Hands-on experience with PySpark.
• Solid experience with Databricks.
• Good knowledge of Microsoft Azure cloud technologies and services.
• Strong understanding of ETL processes and data integration.
• Experience with Data Modelling and data architecture concepts.
• Strong analytical and problem-solving skills.
• Ability to work effectively in a collaborative and international environment.
• Fluency in Portuguese and English, both written and spoken.
• Based in Porto or Lisbon, depending on the candidate's place of residence
• This role offers a gross annual salary between 24.500€ and 60.500€, defined according to the candidate’s experience and competencies.
• Permanent contract (CTI).
• Health Insurance.
• Extra holiday: Christmas Eve or New Year’s Eve.
• Access to Quanteam Academy for continuous learning and certifications.
• Elevate Program to support professional development and career growth.
• Ongoing follow-up and technical support provided by a Consultant Expert.