Senior Data Engineer: Spark & Cloud Pipelines

Santander; Madrid; Presencial; EUR 80.000 - 120.000; Jornada completa

Descripción de la vacante

Open Digital Services, Santander's software arm, is seeking a Senior Data Engineer to design and optimize scalable data pipelines. You will work on Spark-based processing in cloud environments, building datasets for analytics and ML teams while ensuring data quality and governance.

You will collaborate with Data Engineering, Data Science and business teams to deliver reliable data solutions, adopting CI/CD and automation best practices.

Formación

• 5+ years of experience in Data Engineering or related roles.
• Hands-on with Apache Spark in real projects, preferably Scala.
• Experience building production-grade data pipelines in large-scale environments.
• Experience with cloud data platforms (AWS preferred).
• Experience in banking/fintech or regulated environments preferred.
• Fluent Spanish; professional English required.

Responsabilidades

• Design, develop and optimize large-scale data pipelines using Apache Spark, mainly with Scala.
• Build and maintain batch and near real-time data processing solutions for high-volume data.
• Create reliable, reusable datasets consumed by Analytics, Data Science and ML teams.
• Work with cloud data platforms, ideally AWS, to process, transform and store data.
• Implement data quality, validation, monitoring and documentation across pipelines.
• Collaborate with Data Engineering, Data Science, ML and business teams to deliver practical data solutions.
• Contribute to CI/CD and code quality practices.

Conocimientos

Spark / PySpark

Python / Scala

SQL

ETL / ELT design

AWS / Cloud data platforms

Git / DevOps tools

CI/CD

Data quality

Communication

Problem solving

Herramientas

Jenkins

Git

Airflow

Delta Lake

Apache Iceberg

Spark Streaming

Spark (Scala)

Descripción del empleo

Open Digital Services, Santander's software arm, is seeking a Senior Data Engineer to design and optimize scalable data pipelines. You will work on Spark-based processing in cloud environments, building datasets for analytics and ML teams while ensuring data quality and governance.

You will collaborate with Data Engineering, Data Science and business teams to deliver reliable data solutions, adopting CI/CD and automation best practices.