Data Engineer - Hybrid Big Data Pipelines (Spark/Scala)

Tamarind Intelligence; Madrid; Híbrido; EUR 45.000 - 65.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Training programs, career plans

Hybrid telecommuting model (50%)

Diversity and Inclusion Committee

Corporate volunteering (1 MillionHours

Flexible compensation plan

31 vacation days

Descripción de la vacante

BNP Paribas Group in Spain seeks a Data Engineer - Developer to join our SET Iberia IT/Data/Operations team. You will design and maintain data pipelines, ingest data from Kafka, APIs, HDFS and databases into data hubs and products.

You will work with Spark/Scala, Scala-based pipelines, and collaborate across Spain and Portugal in a hybrid work model, with opportunities to grow in a multinational environment and drive data quality and performance.

Formación

• Experience in IT international companies.
• Minimum 2 years of proven success in related positions.
• Languages: English B2/C1, French a bonus.

Responsabilidades

• Data Modeling and Pipelines development using Spark and Scala to ingest and transform data.
• Manage big data storage solutions (HDFS, IBM Cloud Storage, databases).
• Data Transformation and Quality: implement data transformation and quality controls using Spark/SQL.
• CI/CD: set up pipelines for deployment and tests.
• Infrastructure migration to cloud/Kubernetes and Airflow orchestration.
• Implement SQL/NoSQL schemas and views (MongoDB, Oracle, Postgres).
• Schedule data pipelines with shell scripting and Airflow as a service.
• Documentation and knowledge sharing.

Conocimientos

English (B2/C1)

French (bonus)

Herramientas

Spark on Scala

Kafka

Spark Streaming

Airflow

Dremio

HDFS

IBM Cloud Storage

MongoDB

PostgreSQL

Oracle

Descripción del empleo

BNP Paribas Group in Spain seeks a Data Engineer - Developer to join our SET Iberia IT/Data/Operations team. You will design and maintain data pipelines, ingest data from Kafka, APIs, HDFS and databases into data hubs and products.

You will work with Spark/Scala, Scala-based pipelines, and collaborate across Spain and Portugal in a hybrid work model, with opportunities to grow in a multinational environment and drive data quality and performance.