Hybrid Cloud Data Engineer — Spark, Scala & Pipelines

Inetum

Madrid

Hybrid

EUR 60,000 - 85,000

Full time

8 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Inetum in Madrid seeks a data engineer to migrate Hadoop to cloud-based Kubernetes, leveraging Spark, Scala, and SQL. You will implement data transformations, build CI/CD pipelines, automate data pipelines with Airflow, and write technical docs. The role requires collaboration with cross-functional teams and a focus on data quality and performance.

Hybrid work mode in Madrid with occasional travel within Europe. Strong knowledge of HDFS, COS/S3, Parquet, and NoSQL databases is expected.

Qualifications

  • Experience migrating Hadoop to cloud platforms and Kubernetes-based services.
  • Strong SQL and NoSQL knowledge; Spark on Scala experience.
  • Familiar with SDLC, Agile, and CI/CD practices.

Responsibilities

  • Migrate Hadoop infrastructure to cloud infrastructure on Kubernetes Engine, COS, Spark as a service, and Airflow as a service.
  • Implement data transformation and quality to ensure data consistency and accuracy using Scala and SQL; use Spark for transformations.
  • Set up CI/CD pipelines to automate deployments, unit testing and development management.
  • Write and conduct unit and validation tests to ensure code accuracy and integrity.
  • Automate data pipelines and streamline data ingestion using various orchestrators (Airflow as a Service).
  • Write technical documentation (specs, operations) to ensure knowledge capitalization.
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions.
  • Foster continuous learning and improvement within the team.

Skills

Spark on Scala
HDFS
SQL
NoSQL
CI/CD
Airflow

Tools

Kubernetes
Airflow
Parquet
COS
S3

Job description

Inetum in Madrid seeks a data engineer to migrate Hadoop to cloud-based Kubernetes, leveraging Spark, Scala, and SQL. You will implement data transformations, build CI/CD pipelines, automate data pipelines with Airflow, and write technical docs. The role requires collaboration with cross-functional teams and a focus on data quality and performance.

Hybrid work mode in Madrid with occasional travel within Europe. Strong knowledge of HDFS, COS/S3, Parquet, and NoSQL databases is expected.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Cloud Data Engineer - Spark, Scala, Airflow | Hybrid Madrid
Cloud Data Engineer - Spark, Scala, Airflow | Hybrid Madrid

Inetum • Madrid

Hybrid
EUR 60,000 - 90,000
Cloud Data Engineer: Spark, Scala & Airflow on Kubernetes
Cloud Data Engineer: Spark, Scala & Airflow on Kubernetes

Inetum • Comunidad de Madrid

On-site
EUR 60,000 - 75,000
DATA ENGINEER (Scala/Spark)
DATA ENGINEER (Scala/Spark)

Inetum • Comunidad de Madrid

On-site
EUR 60,000 - 75,000
DATA ENGINEER (Scala/Spark)
DATA ENGINEER (Scala/Spark)

Inetum • Madrid

Hybrid
EUR 60,000 - 85,000
Data Engineer
Data Engineer

Inetum • Madrid

Hybrid
EUR 60,000 - 90,000
Data Engineer — Hybrid, Build Scalable Data Pipelines
Data Engineer — Hybrid, Build Scalable Data Pipelines

HN Services España • Madrid

Hybrid
EUR 60,000 - 90,000
Career plan tailored to employee
Progression within the company
Flexible working hours
Senior Data Engineer - Spark, AWS & Fintech, Madrid
Senior Data Engineer - Spark, AWS & Fintech, Madrid

Banco Santander SA • Madrid

Hybrid
EUR 70,000 - 95,000
Senior Data Engineer - Spark & Scala | Data Lake & Hybrid
Senior Data Engineer - Spark & Scala | Data Lake & Hybrid

May Business Consulting • Madrid

Hybrid
EUR 60,000 - 90,000
Paquete retributivo abierto
Seguro médico y cheques restaurante
Formación gratuita y clases de inglés
+1
Senior Data Engineer - Remote, Cloud + Spark Pipelines
Senior Data Engineer - Remote, Cloud + Spark Pipelines

Plain Concepts Group • Spain

Remote
EUR 60,000 - 90,000
Competitive salary
Remote work flexibility
Healthcare
+5
Senior Data Engineer (Spark/Scala) – Hybrid Madrid
Senior Data Engineer (Spark/Scala) – Hybrid Madrid

Soprasteria1 • Madrid

Hybrid
EUR 60,000 - 90,000
Contrato indefinido
23 días de vacaciones
Formación continua
+3