Spark & Scala Data Engineer - Big Data Pipelines (Hybrid)

W Hunt España; Madrid; Híbrido; EUR 45.000 - 75.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

25 days vacation

Hybrid work: 2 days in office, 3 days/

Descripción de la vacante

Intact Insurance Europe is seeking a data engineer for its Madrid office to design, build and maintain scalable data pipelines supporting analytics and AI initiatives.

You will work with Python, SQL, Spark, AWS, and BI tools to deliver reliable data products, collaborate with data scientists and software engineers, and contribute to CI/CD and data governance. The role offers a hybrid work arrangement and competitive compensation.

Formación

• Hands-on experience building data solutions for advanced analytics.
• Strong knowledge of big‑data technologies such as Hadoop and Spark.
• Strong programming skills in Python, Java, SQL and/or Scala.
• Experience working with large‑scale data environments.
• Knowledge of data processing and data pipeline development.
• Familiarity with advanced analytics and machine‑learning tools.
• Experience with tools such as Anaconda and Spark.

Responsabilidades

• Build data pipelines: integrate diverse sources (HTML, CSV, relational databases, embeddings) using scalable ETLs.
• Modeling and optimization: design analytical models to generate KPIs and efficiently manage large data volumes.
• Enable AI: prepare datasets for ML, LLMs, and RAG systems, integrating AI for natural language queries.
• DataOps and scalability: apply CI/CD, continuous monitoring, and optimize infrastructure.
• Learn as much as you want about the world of alternative investment

Conocimientos

Power BI

SQL

Python

Spark

Data modelling

ETL/ELT

Airflow

AWS

Educación

Advanced degree in Computer Science

Herramientas

Anaconda

Hadoop

Descripción del empleo

Intact Insurance Europe is seeking a data engineer for its Madrid office to design, build and maintain scalable data pipelines supporting analytics and AI initiatives.

You will work with Python, SQL, Spark, AWS, and BI tools to deliver reliable data products, collaborate with data scientists and software engineers, and contribute to CI/CD and data governance. The role offers a hybrid work arrangement and competitive compensation.