Big Data Engineer: Spark ETL & Data Pipelines

Talan; Madrid; Presencial; EUR 45.000 - 65.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Career development opportunities

International projects

Exposure to financial IT systems

Descripción de la vacante

Talan Spain is seeking a Mid-Level Big Data Developer to join the Client Contribution Platform team in Madrid. You will develop, optimize, and maintain large-scale data processing solutions, ensuring performance, scalability, and data quality across the platform.

You will collaborate with technical and business stakeholders in an Agile environment, contributing to design and implementation of modern data engineering solutions while improving existing processes and following DevOps practices.

Formación

• 3+ years of experience in software development and data engineering.
• Strong SQL knowledge (ANSI SQL, Hive SQL, Spark SQL, or equivalent).
• Hands-on experience with Apache Spark and at least one of Scala, Python, or Java.
• Experience with Spark-based platforms (Azure Databricks, EMR, Cloudera, Hive, or similar).
• Experience with Qlik Sense reporting and dashboard development.
• Familiarity with Agile methodologies and DevOps practices.
• Experience with version control and CI/CD tools (Git, GitHub, SonarQube, Nexus).
• Strong analytical and problem-solving skills.
• Ability to work collaboratively within a multidisciplinary team.
• Ability to understand, analyze, and improve business and technical requirements.
• English level B2+ or above.

Responsabilidades

• Design, develop, and maintain ETL and data transformation processes.
• Build, optimize, and support Spark-based data pipelines.
• Develop scalable data processing solutions in a Big Data environment.
• Integrate data from multiple sources while ensuring data quality and consistency.
• Analyze, troubleshoot, and resolve data-related issues.
• Collaborate with cross-functional teams to gather and refine business requirements.
• Participate in Agile ceremonies and contribute to continuous improvement initiatives.
• Follow DevOps and CI/CD best practices throughout the development lifecycle.

Conocimientos

Strong SQL knowledge

Spark experience

Analytical thinking

Team collaboration

English communication

Herramientas

Git

GitHub

SonarQube

Nexus

Azure Databricks

Amazon EMR

Cloudera

Apache Hive

Qlik Sense

Descripción del empleo

Talan Spain is seeking a Mid-Level Big Data Developer to join the Client Contribution Platform team in Madrid. You will develop, optimize, and maintain large-scale data processing solutions, ensuring performance, scalability, and data quality across the platform.

You will collaborate with technical and business stakeholders in an Agile environment, contributing to design and implementation of modern data engineering solutions while improving existing processes and following DevOps practices.