Senior Data Engineer - Spark/Scala Big Data for Market Risk

Talan; Málaga; Presencial; EUR 42.000 - 66.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Private medical insurance

Life insurance

Language lessons

Flexible remuneration

Smart Office Pack

Descripción de la vacante

Talan is seeking a Big Data Engineer to join a Market Risk project within a major financial organization, focusing on data-intensive pipelines and distributed technologies.

You will design, develop, and automate Big Data processes using Spark and Scala, build ETL pipelines and data models, perform data validation, and collaborate with risk and tech teams across borders to raise data quality and reliability.

Formación

• 3–5 years of experience in technology projects involving Big Data or data engineering.
• Hands-on experience designing ETL processes and data models.
• Strong experience with Spark and Scala.
• Solid knowledge of Hadoop ecosystems.
• Advanced SQL skills.
• Experience in data testing and validation.
• Basic Shell scripting knowledge.

Responsabilidades

• Design, develop, and automate Big Data processes using Spark and Scala.
• Build and maintain ETL pipelines and data models for Market Risk use cases.
• Perform data testing, validation, and quality controls to ensure reliable outputs.
• Work closely with other Big Data engineers on shared frameworks and common tasks.
• Collaborate with risk and technical teams in an international environment.
• Contribute to continuous improvement of Big Data workflows and standards.

Conocimientos

Big Data

Spark

Scala

SQL

Hadoop

Data testing

Shell scripting

Herramientas

Azure Databricks

Airflow

Descripción del empleo

Talan is seeking a Big Data Engineer to join a Market Risk project within a major financial organization, focusing on data-intensive pipelines and distributed technologies.

You will design, develop, and automate Big Data processes using Spark and Scala, build ETL pipelines and data models, perform data validation, and collaborate with risk and tech teams across borders to raise data quality and reliability.