Big Data Engineer: Spark, ETL & Data Pipelines

Talan Group

Madrid

On-site

EUR 45,000 - 65,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Career development opportunities
Multicultural environment
International projects
Training opportunities

Job summary

Talan Spain is seeking a Mid-Level Big Data Developer to join the Client Contribution Platform team in Madrid. You will design, build, and optimize large-scale data processing solutions, ensuring high performance, data quality, and scalability across the platform.

You will collaborate with technical and business stakeholders in an Agile environment, implementing modern data engineering solutions while improving existing processes and following DevOps practices.

Qualifications

  • 3+ years of software development and data engineering experience.
  • Strong SQL knowledge (ANSI SQL, Hive SQL, Spark SQL, or equivalent).
  • Hands-on Apache Spark with Scala/Python/Java.
  • Experience with Spark-based platforms such as Azure Databricks, Amazon EMR, Cloudera, Hive, or similar Big Data environments.
  • Experience with Qlik Sense reporting and dashboard development.
  • Familiarity with Agile methodologies and DevOps practices.
  • Experience with version control and CI/CD tools such as Git, GitHub, SonarQube, Nexus.
  • Strong analytical and problem-solving skills.
  • Ability to work collaboratively within a multidisciplinary team.
  • English level B2+ or above.

Responsibilities

  • Design, develop, and maintain ETL and data transformation processes.
  • Build, optimize, and support Spark-based data pipelines.
  • Develop scalable data processing solutions in a Big Data environment.
  • Integrate data from multiple sources while ensuring data quality and consistency.
  • Analyze, troubleshoot, and resolve data-related issues.
  • Optimize data performance and processing efficiency; collaborate with cross-functional teams to refine requirements.
  • Participate in Agile ceremonies and contribute to continuous improvement initiatives.
  • Follow DevOps and CI/CD best practices throughout the development lifecycle.

Skills

SQL
Apache Spark
Python
Scala
Java
Data engineering
ETL
Big Data
CI/CD
Git

Tools

Azure Databricks
Amazon EMR
Cloudera
Apache Hive
Qlik Sense

Job description

Talan Spain is seeking a Mid-Level Big Data Developer to join the Client Contribution Platform team in Madrid. You will design, build, and optimize large-scale data processing solutions, ensuring high performance, data quality, and scalability across the platform.

You will collaborate with technical and business stakeholders in an Agile environment, implementing modern data engineering solutions while improving existing processes and following DevOps practices.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Spark Backend Architect | Big Data Platform
Senior Spark Backend Architect | Big Data Platform

Talan Group • Málaga

On-site
EUR 70,000 - 110,000
Remote Backend Spark Developer — Data Pipelines
Remote Backend Spark Developer — Data Pipelines

Talan Group • Málaga

Remote
EUR 40,000 - 55,000
Remote Spark Backend Developer | Mid-Level
Remote Spark Backend Developer | Mid-Level

Talan • Córdoba

Remote
EUR 40,000 - 60,000
Data Engineer: Data Lake & ETL Pipelines (Remote CET)
Data Engineer: Data Lake & ETL Pipelines (Remote CET)

Talan • Madrid

Remote
EUR 42,000 - 64,000
Remote within CET Time zone
International projects
Remote Data Engineer – Data Lake, ETL & Pipelines
Remote Data Engineer – Data Lake, ETL & Pipelines

Talan • Spain

Remote
EUR 42,000 - 64,000
Remote within CET Time zone
Senior Data Engineer - Spark, Scala & Cloud Data Pipelines
Senior Data Engineer - Spark, Scala & Cloud Data Pipelines

Banco Santander SA • Spain

On-site
EUR 65,000 - 90,000
Senior Data Engineer - Spark, AWS & Fintech, Madrid
Senior Data Engineer - Spark, AWS & Fintech, Madrid

Banco Santander SA • Madrid

Hybrid
EUR 70,000 - 95,000
Remote Big Data Engineer: Spark, Java & Microservices
Remote Big Data Engineer: Spark, Java & Microservices

Talan Group • Málaga

Hybrid
EUR 40,000 - 70,000
Smart Office Pack
Training & career development
Private medical insurance
+3
Big Data Developer
Big Data Developer

Talan Group • Madrid

On-site
EUR 45,000 - 65,000
Career development opportunities
Multicultural environment
International projects
+1
Data Engineer: Databricks & Spark Pipelines (Madrid)
Data Engineer: Databricks & Spark Pipelines (Madrid)

AXON Networks • Madrid

Hybrid
EUR 45,000 - 65,000
Free parking/Pluxee transport pass
Pluxee restaurant pass
Private medical insurance (family)