Hybrid Data Engineer (Lisbon) - Big Data Pipelines & Spark

IRIUM Portugal; Lisboa; Híbrido; EUR 42 000 - 65 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Flexible pay

Medical insurance

Technology training

Resumo da oferta

IRIUM Portugal, based in Lisbon, is hiring a Data Engineer (Spoke) to join a hybrid team. You will upload data to the Big Data Platform, prepare data profiles for specific use cases, and develop ready-to-use data pipelines, collaborating with service providers on complex integration tasks.

We expect 4 years of experience, English C1, and strong knowledge of Spark, Python, AWS, and Docker. You will work with distributed systems, CI/CD, and agile Scrum practices, contributing to data products in

Qualificações

• 4 years of experience required.
• English: C1 level.

Responsabilidades

• Uploading data to the Big Data Platform.
• Targeted preparation of data for specific use cases and creation of data profiles.
• Development of ready-to-use data pipelines.
• Coordination of the service provider's activities (only complex).

Conhecimentos

Apache Spark

Python

R

Scala

Java

Kotlin

AWS Cloud Ingestion

S3 Databases

Batch & real-time interfaces

Distributed systems

Docker

Resource Manager

CI/CD pipelines

Workflow managers

Scrum

Agile development

Automotive industry knowledge

Ferramentas

CI/CD tools

Workflow managers

Descrição da oferta de emprego

IRIUM Portugal, based in Lisbon, is hiring a Data Engineer (Spoke) to join a hybrid team. You will upload data to the Big Data Platform, prepare data profiles for specific use cases, and develop ready-to-use data pipelines, collaborating with service providers on complex integration tasks.

We expect 4 years of experience, English C1, and strong knowledge of Spark, Python, AWS, and Docker. You will work with distributed systems, CI/CD, and agile Scrum practices, contributing to data products in