Data Engineer: Spark, Kafka & Cloud Pipelines

Extia Group; Madrid; Presencial; EUR 50.000 - 75.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Real flexibility

Personalized training plan

Triple Follow-up

Competitive benefits package

International environment

Great Place to Work

Events, afterworks & active community

Descripción de la vacante

Extia Group is seeking a Data Engineer in Madrid to guide data engineering across squads, ensuring robust pipelines and scalable data infrastructure. You will migrate legacy platforms to modern hubs and evolve data ecosystems with cutting-edge technologies.

Responsibilities include designing pipelines, collaborating with teams, maintaining data quality, and automating ingestion using Airflow as a Service. Strong French, Spark/Scala, Kafka, COS, SQL/NoSQL, CI/CD, Hadoop, and ELK experience are

Formación

• Fluent in French (B2/C1) required.
• Strong knowledge of Spark on Scala.
• Experience with Kafka and event streams.
• Proficiency with S3/Cloud Object Storage (COS) and Parquet format.
• Strong knowledge of SQL and NoSQL databases.
• Experience with CI/CD tooling (GitLab, Jenkins).
• Experience with Hadoop and shell scripting.
• Familiarity with SDLC and Agile ceremonies.
• Experience with Elasticsearch and Kibana.
• Use of GenAI tools for tests, docs and development improvements.
• Familiarity with Vault (HVault).
• Excellent problem-solving and attention to detail.
• Ability to manage Business/IT relations and IT Operations.
• Strong communication and collaboration skills.
• Ability to drive change and deliver results.
• Commitment to continuous learning.

Responsabilidades

• Lead design, development and maintenance of scalable data pipelines and systems.
• Collaborate with cross-functional teams to understand data requirements and deliver solutions.
• Ensure performance, security, data quality and integrity of data infrastructure.
• Automate data pipelines and ingestion using orchestrators, primarily Airflow as a Service.
• Design and implement scalable data processing with Scala, Spark and COS.
• Set up CI/CD pipelines for deployments and unit testing.
• Write unit tests and validations; produce technical docs for knowledge sharing.
• Mentor junior data engineers and foster continuous improvement.

Conocimientos

Problem solving

Communication

Interpersonal skills

Change management

Delivery mindset

Continuous learning

Business/IT liaison

Attention to detail

Mentoring

Herramientas

Spark

Scala

SQL

NoSQL databases

GitLab

Jenkins

Hadoop

Airflow

Elasticsearch

Kibana

Cloud Object Storage (COS)

Parquet

GenAI tools

Vault (HVault)

Descripción del empleo

Extia Group is seeking a Data Engineer in Madrid to guide data engineering across squads, ensuring robust pipelines and scalable data infrastructure. You will migrate legacy platforms to modern hubs and evolve data ecosystems with cutting-edge technologies.

Responsibilities include designing pipelines, collaborating with teams, maintaining data quality, and automating ingestion using Airflow as a Service. Strong French, Spark/Scala, Kafka, COS, SQL/NoSQL, CI/CD, Hadoop, and ELK experience are