Data Engineer

Arrow Global Group; Lisboa; Presencial; EUR 45 000 - 65 000; Tempo integral

Resumo da oferta

Arrow Global Group is seeking a skilled Azure Data Engineer in Portugal to join a new data-focused group. You will build resilient data pipelines using ADF and Databricks to load, transform, and model data from multiple sources for portfolio analytics and risk management.

The role requires experience with Python, Spark SQL, and data integration best practices, working with IT & Change stakeholders to deliver auditable datasets at scale.

Qualificações

• Degree in a computing or data-related field is preferred.
• Proven experience building resilient, reusable data pipelines as a Data Engineer.
• Strong collaboration and communication skills; financial data domain knowledge is a plus.

Responsabilidades

• Serve as the team’s Azure Data Factory and Databricks technical expert.
• Build, ingest, and transform raw data into relational data models.
• Collaborate with data stewards and analysts to define data standards.
• Design scalable data pipelines across multiple source systems.
• Tune and optimize data ingestion and integration processes.
• Ensure auditable data delivery for analytics and risk purposes.

Conhecimentos

ADF

Databricks

Python

PySpark

Spark SQL

Data modeling

Data pipelines

Formação académica

Bachelor's degree in Computer Science/Information Systems/Data Science

Ferramentas

Azure Data Factory

Databricks

SQL

Descrição da oferta de emprego

Description

We are seeking highly skilled and experienced Azure Data Engineers to join a newly formed group concentrating on Data. Within this role you will be a key member of the team, working on a complex and challenging project within the Financial Services/Capital Markets industry. The primary focus of the role would be on building resilient, reusable Data Pipelines to extract, load, and transform raw data into a relational data model. The successful candidate will work across complex, multi-source datasets including loan servicing systems, property and valuation platforms, collections systems, and third-party data providers, delivering reliable and auditable data at scale.

Department: IT & Change

Location: Portugal

Description

We are seeking highly skilled and experienced Azure Data Engineers to join a newly formed group concentrating on Data. Within this role you will be a key member of the team, working on a complex and challenging project within the Financial Services/Capital Markets industry. The primary focus of the role would be on building resilient, reusable Data Pipelines to extract, load, and transform raw data into a relational data model. The successful candidate will work across complex, multi-source datasets including loan servicing systems, property and valuation platforms, collections systems, and third-party data providers, delivering reliable and auditable data at scale.

Key Responsibilities

• Serve as the team’s ADF, Databricks, Python, PySpark & Spark SQL technical expert
• Responsible for day-to-day collection & ingestion of raw data into corporate data assets
• Work with the team to formalize data flows and data standards
• Enable trusted datasets for portfolio analytics, asset strategy, finance, and risk
• Supervise all data ingestion & integration processes from source to target including the data warehouse, data lake, etc
• Performance tune and optimize all data ingestion and data integration processes
• Partner with Data Stewards and Business Analysts to understand the nature of the data being handled and what an optimal Data Pipeline for it should look like
• Design solutions that are aligned to the target state Data Architecture

About You

• Degree in Computer Science, Information Systems, Data Science, or a related field is preferable
• Proven experience building resilient, reusable Data Pipelines as a Data Engineer or equivalent
• Resourceful, motivated self-starter with the ability to collaborate across business and technology
• Strong analytical, verbal, and written communication skills
• A background in financial data domains (IBOR/ABOR, transactions, market data, reference data)
• Strong experience as a Data Engineer within Real Estate, Credit, Banking, or NPL Asset Management
• Microsoft certification a plus