Senior Spark Data Engineer - AWS & Data Pipelines

Banco Santander SA; Madrid; Presencial; EUR 90.000 - 120.000; Jornada completa

Descripción de la vacante

Open Digital Services in Madrid is seeking a Senior Data Engineer to design and optimize scalable data pipelines using Apache Spark and cloud platforms. You will work on batch and near-real-time processing, creating reliable datasets for analytics, ML and reporting, while ensuring data quality and proper documentation.

The role requires strong PySpark/Scala skills, experience with Spark SQL, and hands-on experience with AWS-based data platforms.

Formación

• 5+ years of experience in Data Engineering or related roles.
• Hands-on experience building production-grade data pipelines in large-scale environments.
• Experience with Apache Spark in real projects, preferably Scala.

Responsabilidades

• Design, build and optimize large-scale data pipelines using Spark (Scala/PySpark).
• Develop batch and near-real-time data processing solutions for high-volume environments.
• Collaborate with Analytics, Data Science and ML teams to deliver usable datasets and insights.
• Ensure data quality, monitoring and documentation across pipelines.

Conocimientos

PySpark

Spark SQL

Python

Scala

SQL

ETL/ELT

AWS

CI/CD

Git

Data quality

Herramientas

Airflow

Git

Descripción del empleo

Open Digital Services in Madrid is seeking a Senior Data Engineer to design and optimize scalable data pipelines using Apache Spark and cloud platforms. You will work on batch and near-real-time processing, creating reliable datasets for analytics, ML and reporting, while ensuring data quality and proper documentation.

The role requires strong PySpark/Scala skills, experience with Spark SQL, and hands-on experience with AWS-based data platforms.