DATA ENGINEER (Scala/Spark)

Inetum

Madrid

Hybrid

EUR 60,000 - 85,000

Full time

8 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Inetum in Madrid seeks a data engineer to migrate Hadoop to cloud-based Kubernetes, leveraging Spark, Scala, and SQL. You will implement data transformations, build CI/CD pipelines, automate data pipelines with Airflow, and write technical docs. The role requires collaboration with cross-functional teams and a focus on data quality and performance.

Hybrid work mode in Madrid with occasional travel within Europe. Strong knowledge of HDFS, COS/S3, Parquet, and NoSQL databases is expected.

Qualifications

  • Experience migrating Hadoop to cloud platforms and Kubernetes-based services.
  • Strong SQL and NoSQL knowledge; Spark on Scala experience.
  • Familiar with SDLC, Agile, and CI/CD practices.

Responsibilities

  • Migrate Hadoop infrastructure to cloud infrastructure on Kubernetes Engine, COS, Spark as a service, and Airflow as a service.
  • Implement data transformation and quality to ensure data consistency and accuracy using Scala and SQL; use Spark for transformations.
  • Set up CI/CD pipelines to automate deployments, unit testing and development management.
  • Write and conduct unit and validation tests to ensure code accuracy and integrity.
  • Automate data pipelines and streamline data ingestion using various orchestrators (Airflow as a Service).
  • Write technical documentation (specs, operations) to ensure knowledge capitalization.
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions.
  • Foster continuous learning and improvement within the team.

Skills

Spark on Scala
HDFS
SQL
NoSQL
CI/CD
Airflow

Tools

Kubernetes
Airflow
Parquet
COS
S3

Job description

At Inetum, a leading international digital consultancy, we empower 27,000 professionals across 27 countries to shape their careers, foster innovation, and achieve work-life balance. Proudly certified as aTop Employer Europe 2026, we’re passionate about creating positive and impactful digital solutions.

Job Description

Hybrid work mode in Madrid. This service could imply a willingness to travel occasionally within Italy.

The main responsibilities are:

  • Migrate the existing Hadoop infrastructure to cloud infrastructure on Kubernetes Engine, COS, Spark as a service, and Airflow as a service.
  • Implement data transformation and quality to ensure data consistency and accuracy. Utilize programming languages such as Scala and SQL and tools like Spark for data transformation and enrichment operations.
  • Set up CI/CD pipelines to automate deployments, unit testing and development management.
  • Write and conduct unit and validation tests to ensure accuracy and integrity of code developed.
  • Automate data pipelines and streamline data ingestion through the implementation of different orchestrators and scheduling processes (Airflow as a Service mainly).
  • Writing technical documentation (specifications, operational documents) to ensure knowledge capitalization.
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions.
  • Foster a culture of continuous learning and improvement within the team.
Qualifications

Good knowledge of:

  • Spark on Scala
  • HDFS and structured databases (SQL)
  • S3 storage/COS and parquet (and ORC) format
  • Strong knowledge of SQL and NoSQL databases
  • Hadoop

Full understanding of:

  • Shell script
  • Software Development Lifecycle (SDLC) awareness
  • Agile principles and ceremonies
  • Design effective prompts to leverage Gen AI tools across IT domains (e.g., development, testing, data generation, documentation) during the development stage.

Some knowledge of:

  • Dremio as tool to virtualize data

Optionally/ as a plus:

  • Elasticsearch and Kibana
  • HVault
Additional Information
BUSINESS AND TRANSVERSAL SKILLS
  • Knowledge of banking industry and processes
  • Problem-Solving and Decision-Making person
  • Business / IT relationship (including IT OPS)
  • Ability to understand, explain and support change
  • Ability to Deliver / Results driven
  • Ability to collaborate / Teamwork with data squads and business teams
LANGUAGES
  • Optionally Fench
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Inetum • Madrid

Hybrid
EUR 60,000 - 90,000
DATA ENGINEER (Scala/Spark)
DATA ENGINEER (Scala/Spark)

Inetum • Comunidad de Madrid

On-site
EUR 60,000 - 75,000
Hybrid Cloud Data Engineer — Spark, Scala & Pipelines
Hybrid Cloud Data Engineer — Spark, Scala & Pipelines

Inetum • Madrid

Hybrid
EUR 60,000 - 85,000
Cloud Data Engineer - Spark, Scala, Airflow | Hybrid Madrid
Cloud Data Engineer - Spark, Scala, Airflow | Hybrid Madrid

Inetum • Madrid

Hybrid
EUR 60,000 - 90,000
Cloud Data Engineer: Spark, Scala & Airflow on Kubernetes
Cloud Data Engineer: Spark, Scala & Airflow on Kubernetes

Inetum • Comunidad de Madrid

On-site
EUR 60,000 - 75,000
Data Engineer
Data Engineer

HN Services España • Madrid

Hybrid
EUR 60,000 - 90,000
Career plan tailored to employee
Progression within the company
Flexible working hours
Data Engineer
Data Engineer

Applusidiada1 • Tarragona

On-site
EUR 42,000 - 62,000
Senior Data Engineer
Senior Data Engineer

Intellias • Spain

Remote
EUR 90,000 - 140,000
Senior Data Engineer
Senior Data Engineer

Plain Concepts Group • Spain

Remote
EUR 60,000 - 90,000
Competitive salary
Remote work flexibility
Healthcare
+5
Data Engineer (Databricks & Treasury Data Lake), Remote (EU) – International Client
Data Engineer (Databricks & Treasury Data Lake), Remote (EU) – International Client

TheWhiteam • Spain

Remote
EUR 48,000 - 63,000