Senior Data Engineer - Scala/Spark on AWS (Hybrid)

Open Digital Services; España; Híbrido; EUR 65.000 - 95.000; Jornada completa

Descripción de la vacante

Open Digital Services in Spain is seeking a Senior Data Engineer to design, build and optimize scalable data pipelines using Spark-based technologies. You will work with PySpark or Spark SQL to deliver robust data solutions for analytics, ML and reporting in cloud environments.

The role is Madrid-based with two days in the office or remote within Spain, and requires strong data engineering fundamentals, experience with Spark and SQL, and collaboration with cross-functional teams across

Formación

• 5+ years of experience in Data Engineering, Big Data Engineering, Software Engineering or similar technical roles.
• Experience building production-grade data pipelines in large-scale or complex data environments.
• Hands-on experience working with Apache Spark in real projects, preferably with Scala.
• Experience working with cloud data platforms.
• Experience in banking, fintech or regulated environments.
• Fluent Spanish preferred, Professional English required.
• Strong experience with Spark-based distributed processing.
• Strong Python or Scala coding skills for data engineering use cases.
• Solid SQL knowledge and experience with relational/analytical databases.
• Experience designing and optimizing ETL/ELT processes.
• Experience with AWS or similar cloud ecosystems; ideally S3, Glue, Athena, EMR, Redshift, IAM or Lake Formation.
• Experience with Git and collaborative software development practices.
• Understanding of data quality, validation, monitoring and performance optimization.
• Experience with CI/CD or DevOps tools such as Jenkins, Sonar, Nexus, Jira, Splunk or similar.
• Experience with Apache Flink, Spark Streaming or near-real-time applications.
• Experience with Apache Iceberg, Delta Lake or modern lakehouse formats.
• Experience with Airflow or workflow orchestration tools.

Responsabilidades

• Designing, developing and optimizing large-scale data pipelines using Apache Spark, mainly with Scala/Spark.
• Building and maintaining batch and near-real-time data processing solutions for high-volume data environments.
• Creating reliable, reusable and well-structured datasets consumed by Analytics, Data Science, Machine Learning and business teams.
• Working with cloud data platforms, ideally AWS, to process, transform, store and expose data efficiently.
• Implementing data quality, validation, monitoring and documentation practices across data pipelines.
• Collaborating with Data Engineering, Data Science, Machine Learning, Architecture and business teams to understand requirements and deliver practical data solutions.
• Contributing to engineering best practices around code quality, testing, version control, CI/CD and automation.

Descripción del empleo

Open Digital Services in Spain is seeking a Senior Data Engineer to design, build and optimize scalable data pipelines using Spark-based technologies. You will work with PySpark or Spark SQL to deliver robust data solutions for analytics, ML and reporting in cloud environments.

The role is Madrid-based with two days in the office or remote within Spain, and requires strong data engineering fundamentals, experience with Spark and SQL, and collaboration with cross-functional teams across