Cloud Data Engineer: Spark, Scala & Airflow on Kubernetes

Inetum

Comunidad de Madrid

On-site

EUR 60,000 - 75,000

Full time

20 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Inetum is seeking a data engineer to migrate Hadoop to cloud-based data platforms and build scalable pipelines. You will transform data using Spark, Scala and SQL, implement testing, and automate deployments within an agile environment.

You will work with cross-functional teams to ensure data quality, governance, and operational excellence while contributing to knowledge sharing and continuous improvement in a dynamic, international setting.

Qualifications

  • Experience with Spark on Scala and Hadoop ecosystem.
  • Strong SQL skills and knowledge of NoSQL databases.
  • Hands-on data transformation, quality checks, and data enrichment tasks.

Responsibilities

  • Migrate Hadoop infrastructure to cloud infrastructure on Kubernetes Engine, COS, Spark as a service, and Airflow as a service.
  • Implement data transformation and quality processes using Spark, Scala, and SQL.
  • Set up CI/CD pipelines to automate deployments, unit tests and development management.
  • Write and run unit and validation tests to ensure code accuracy and integrity.
  • Automate data pipelines and orchestration with Airflow as a Service.
  • Write technical documentation to capture specifications and operational details.
  • Collaborate with cross-functional teams to meet data requirements and deliver solutions.
  • Foster a culture of continuous learning and improvement within the team.

Skills

Spark/Scala
SQL/NoSQL
Hadoop
Shell scripting
SDLC/Agile
Data transformation
Gen AI prompts

Tools

Dremio
Elasticsearch
Kibana
HVault

Job description

Inetum is seeking a data engineer to migrate Hadoop to cloud-based data platforms and build scalable pipelines. You will transform data using Spark, Scala and SQL, implement testing, and automate deployments within an agile environment.

You will work with cross-functional teams to ensure data quality, governance, and operational excellence while contributing to knowledge sharing and continuous improvement in a dynamic, international setting.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Cloud Data Engineer - Spark, Scala, Airflow | Hybrid Madrid
Cloud Data Engineer - Spark, Scala, Airflow | Hybrid Madrid

Inetum • Madrid

Hybrid
EUR 60,000 - 90,000
Hybrid Cloud Data Engineer — Spark, Scala & Pipelines
Hybrid Cloud Data Engineer — Spark, Scala & Pipelines

Inetum • Madrid

Hybrid
EUR 60,000 - 85,000
DATA ENGINEER (Scala/Spark)
DATA ENGINEER (Scala/Spark)

Inetum • Comunidad de Madrid

On-site
EUR 60,000 - 75,000
DATA ENGINEER (Scala/Spark)
DATA ENGINEER (Scala/Spark)

Inetum • Madrid

Hybrid
EUR 60,000 - 85,000
Data Engineer
Data Engineer

Inetum • Madrid

Hybrid
EUR 60,000 - 90,000
Senior Data Engineer - Remote, Cloud + Spark Pipelines
Senior Data Engineer - Remote, Cloud + Spark Pipelines

Plain Concepts Group • Spain

Remote
EUR 60,000 - 90,000
Competitive salary
Remote work flexibility
Healthcare
+5
Spark & Scala Data Engineer — Real-Time Pipelines in Cloud
Spark & Scala Data Engineer — Real-Time Pipelines in Cloud

Capgemini • Madrid

On-site
EUR 40,000 - 55,000
24 días de vacaciones + días adicionales
Flexibilidad para trabajar en remoto
Programas de formación continua
+1
Senior Data Engineer - Spark & AWS Platform Architect
Senior Data Engineer - Spark & AWS Platform Architect

Holcim • Madrid

On-site
EUR 90,000 - 130,000
Senior Data Engineer - Spark, Kafka & Data Lakes
Senior Data Engineer - Spark, Kafka & Data Lakes

Adikteev • Barcelona

On-site
EUR 80,000 - 90,000
Competitive salary 80-90k EUR OTE
4.5 days work week
Mental Health support
+3
Cloud Data Platform Engineer - Remote & Growth
Cloud Data Platform Engineer - Remote & Growth

SDG Group • Santiago de Compostela

Hybrid
EUR 45,000 - 75,000
Hybrid working model
Private health insurance
Meal vouchers
+1