Senior Spark Data Engineer | Cloud Data Pipelines

Santander; Madrid; On-site; EUR 85,000 - 105,000; Full time

Job summary

Open Digital Services, Santander Group's software development arm, seeks a Senior Data Engineer to design and optimize scalable data solutions that support analytics, ML and business decisions. You will build robust pipelines with Spark (Scala/PySpark), work in cloud environments (AWS), ensure data quality and governance, and collaborate across Data Engineering, Data Science and business teams.

Strong focus on data processing, lakehouse patterns and end-to-end production readiness in a

Qualifications

• 5+ years of experience in Data Engineering or related roles.
• Experience building production-grade data pipelines in large-scale or complex data environments.
• Hands-on experience working with Apache Spark in real projects, preferably with Scala.
• Experience working with cloud data platforms, preferably AWS.
• Experience in banking, fintech or regulated environments is preferred.

Responsibilities

• Designing, developing and optimizing large-scale data pipelines using Apache Spark, mainly with Scala/Spark.
• Building and maintaining batch and near-real-time data processing solutions for high-volume data environments.
• Creating reliable, reusable and well-structured datasets consumed by Analytics, Data Science, Machine Learning and business teams.
• Working with cloud data platforms, ideally AWS, to process, transform, store and expose data efficiently.
• Implementing data quality, validation, monitoring and documentation practices across data pipelines.
• Collaborating with Data Engineering, Data Science, ML and business teams to understand requirements and deliver practical data solutions.
• Contributing to engineering best practices around code quality, testing, version control, CI/CD and automation.

Skills

PySpark

Spark SQL

Scala

Python

SQL

Data pipelines

CI/CD practices

Tools

AWS

Git

Jira

Airflow

Delta Lake

Iceberg

Spark Streaming

Flink

S3

Job description

Open Digital Services, Santander Group's software development arm, seeks a Senior Data Engineer to design and optimize scalable data solutions that support analytics, ML and business decisions. You will build robust pipelines with Spark (Scala/PySpark), work in cloud environments (AWS), ensure data quality and governance, and collaborate across Data Engineering, Data Science and business teams.

Strong focus on data processing, lakehouse patterns and end-to-end production readiness in a